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(57) An image interpolating method for interpolating 
a pixel at an intermediate position between a first origi- 
nal pixel and a second original pixel adjacent to the first 
original pixel, comprising a first step of calculating an 
edge component forjudging whether or not an interpo- 
lated pixel is positioned in the vicinity of an edge position 
of original image data, a second step of determining a 
range where pixel data on the interpolated pixel is set- 
table on the basis of the calculated edge component and 
pixel data on the first and second original pixels, and a 
third step of selecting a plurality of sets of opposed pix- 
els between which the interpolated pixel is sandwiched 
diagonally, and determining, for each of the sets, the pix- 
el data on the interpolated pixel in a case where a cor- 
relation value represented by the sum of the absolute 
values of the differences between the pixel data on the 
interpolated pixel and pixel data on the opposed pixels 
is the minimum in the range where the pixel data on the 
interpolated pixel is settable and the minimum correla- 
tion value. 
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Description 

<Technical Field> 

5 [0001] The present invention relates to an image interpolating method for interpolating an image. 
<Background Art> 

[0002] Conventionally in cases such as a case where an interlace image is converted into a progressive image, a 
10 case where an image is enlarged, and a case where the resolution of an image is enhanced, various methods of 
interpolating an image have been proposed using pixel data on adjacent original pixels (corresponding to the amount 
of data representing luminance on a display). 

[0003] Typical examples of an image interpolating method are a simple interpolating method and a linear interpolating 
method. The simple interpolating method is a method of giving pixel data on either one of pixels adjacent to a pixel to 

15 be interpolated on the upper and lower sides (or on the right and left sides) to the pixel to be interpolated as pixel data. 
The linear interpolating method is a method of giving the average of pixel data on pixels adjacent to a pixel to be 
interpolated on the upper and lower sides (on the right and left sides) to the pixel to be interpolated as pixel data. 
[0004] In the simple interpolating method, however, the pixel data on the pixel adjacent to the pixel to be interpolated 
is given as it is. When there is a diagonal edge portion in an image reproduced on a display or the like, backlash occurs 

20 jn the edge portion. On the other hand, in the linear interpolating method, the average of the pixel data on the pixels 
adjacent to the pixel to be interpolated on the upper and lower sides (on the right and left sides) is given. Accordingly, 
the vicinity of the pixel to be interpolated is an edge portion. When the difference between the pixel data on the pixels 
adjacent to the pixel to be interpolated on the upper and lower sides (on the right and left sides) is large, the interpolated 
pixel takes an intermediate value, so that the edge portion is blurred. 

25 [0005] The present invention provides an image interpolating method capable of preventing backlash and blur from 
occurring in an edge portion in interpolating an image as well as capable of reproducing a smooth image. 

<Disclosure of lnvention> 

30 [1] Description of First Image Interpolating Method According to Present Invention 

[0006] In an image interpolating method for interpolating a pixel at an intermediate position between a first original 
pixel and a second original pixel adjacent to the first original pixel, a first image interpolating method according to the 
present invention is characterized by comprising a first step of calculating an edge component for judging whether or 

35 not an interpolated pixel exists in the vicinity of an edge position of original image data; a second step of finding a 
range where pixel data on the interpolated pixel is settable on the basis of the calculated edge component and pixel 
data on the first and second original pixels; a third step of selecting a plurality of sets of opposed pixels between which 
the interpolated pixel is sandwiched diagonally, and finding, for each of the sets, the pixel data on the interpolated pixel 
in a case where a correlation value represented by the sum of the absolute values of the differences between the pixel 

40 data on the interpolated pixel and pixel data on the opposed pixels is the minimum in the range where the pixel data 
on the interpolated pixel is settable and the minimum correlation value; and a fourth step of finding the pixel data on 
the interpolated pixel on the basis of the pixel data on the interpolated pixel in the case where the correlation value is 
the minimum and the minimum correlation value which are found for each of the sets. 

[0007] When an original pixel adjacent to the first original pixel and opposite to the second original pixel is taken as 
^5 a third original pixel, and an original pixel adjacent to the second original pixel and opposite to the first original pixel is 
taken as a fourth original pixel, the edge component is calculated on the basis of pixel data on the first to fourth original 
pixels at the first step. 

[0008] More specifically, letting d1 be the pixel data on the first original pixel, 62 be the pixel data on the second 
original pixel, d3 be the pixel data on the third original pixel, and d4 be the pixel data on the fourth original pixel, an 
so edge component E is calculated on the basis of the following equation (1) : 

E = -d3 + d1 +62- 64 (1) 

55 [0009] Letting E be the edge component found at the first step, Th be a predetermined threshold, d max be the larger 
one of the pixel data on the first original pixel and the pixel data on the second original pixel, d mjn be the smaller one 
of them, and d be d max -d mjn , a range S where the pixel data on the interpolated pixel is settable is found on the basis 
of the following expression (2) at the second step: 
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if E > Th, then d mjn + d/2 =i S =1 d max , 
if -Th ^ E ^ Th, then d min + d/4 ^ S ^ d max -d/4, and 

if E < -Th, then d mln ^ S ^ d mln + d/2 (2) 

[0010] Letting x be the pixel data in the settable range S found at the second step, and da and db be respectively 
the pixel data on the two original pixels composing one set of opposed pixels, a correlation value L corresponding to 
10 the set is calculated by the following equation (3): 

L = Ida-xl + Idb-xl (3) 

15 [0011] Used as the fourth step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the third step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and determining, when there are a plurality of minimums of 
20 the minimum correlation values, the average of the pixel data on the interpolated pixel in a case where the minimums 
of the minimum correlation values are respectively given as the pixel data on the interpolated pixel. 
[0012] Used as the fourth step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the third step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
25 correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and extracting, when there are a plurality of minimums of 
the minimum correlation values, the maximum and the minimum of the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values are respectively given, and determining the average of the 
extracted maximum and minimum as the pixel data on the interpolated pixel. 

[0013] Used as the fourth step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the third step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and selecting, when there are a plurality of minimums of the 
35 minimum correlation values, the pixel data obtained from opposed pixels in closest proximity to the interpolated pixel 
out of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 
respectively given, and determining, when the number of the selected pixel data is one, the pixel data as the pixel data 
on the interpolated pixel, while determining, when the number of the selected pixel data is two, the average of the pixel 
data as the pixel data on the interpolated pixel. 
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[2] Description of Second Image Interpolating Method According to Present Invention 



[0014] In an image interpolating method for interpolating a pixel at an intermediate position between a first original 
pixel and a second original pixel adjacent to the first original pixel, a second image interpolating method according to 
the present invention is characterized by comprising a first step of calculating an edge component forjudging whether 
or not an interpolated pixel exists in the vicinity of an edge position of original image data; a second step of correcting 
the calculated edge component on the basis of a predetermined pseudo noise component; a third step of finding a 
range where pixel data on the interpolated pixel is settable on the basis of an edge component after the correction and 
pixel data on the first and second original pixels; a fourth step of selecting a plurality of sets of opposed pixels between 
which the interpolated pixel is sandwiched diagonally, and finding, for each of the sets, the pixel data on the interpolated 
pixel in a case where a correlation value represented by the sum of the absolute values of the differences between 
the pixel data on the interpolated pixel and pixel data on original pixels in the vicinity of the opposed pixels is the 
minimum in the range where the pixel data on the interpolated pixel is settable and the minimum correlation value; and 
a fifth step of finding the pixel data on the interpolated pixel on the basis of the pixel data on the interpolated pixel in 
the case where the correlation value is the minimum and the minimum correlation value which are found for each of 
the sets. 

[001 5] When an original pixel adjacent to the first original pixel and opposite to the second original pixel is taken as 
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a third original pixel, and an original pixel adjacent to the second original pixel and opposite to the first original pixel is 
taken as a fourth original pixel, the edge component is calculated on the basis of pixel data on the first to fourth original 
pixels at the first step. 

[0016] More specifically, letting d1 be the pixel data on the first original pixel, 62 be the pixel data on the second 
original pixel, d3 be the pixel data on the third original pixel, and d4 be the pixel data on the fourth original pixel, an 
edge component E is calculated on the basis of the following equation (4) : 

E = -d3 + d1 + 62 - d4 (4) 

[0017] Letting Q be a pseudo noise component, and E be the edge component calculated at the first step, an edge 
component E1 after the correction found at the second step is given by the following expression (5) : 

if -Q ^ E ^ G, then E1 = 0, and 

if E > Q or E < -Q, then E1 = E (5) 

[0018] Letting E1 be the edge component after the correction found at the second step, d max be the larger one of 
the pixel data on the first original pixel and the pixel data on the second original pixel, d mln be the smaller one of them, 
dc be the average of d max and d mjn , and a (0 ^ a ^ 1 ) and y be previously set factors, a range S where the pixel data 
on the interpolated pixel is settable is found on the basis of the following expression (6) at the third step: 

if E1 ^ O.then d mln . a + dc (1-a) ^ s ^ d max « a + dc(1-a)+ E1 - y, and 

if E1 < 0, then d mjn -a + dc(1 -a) + E1 -y ^ S ^ d max - a + dc(1 -a) (6) 

[0019] When a direction connecting the first original pixel and the second original pixel is defined as a vertical direc- 
tion, a direction perpendicular to the vertical direction is defined as a right-and-left direction, a set of opposed pixels 
is taken as D1 2 and D24, two original pixels adjacent to the one opposed pixel D1 2 on the right and left sides are taken 
as D11 and D13, two original pixels adjacent to the opposed pixel D12on the upper and lower sides are taken as D02 
and D22, two original pixels adjacent to the other opposed pixel D24 on the right and left sides are taken as D23 and 
D25, two original pixels adjacent to the opposed pixel D24 on the upper and lower sides are taken as D14 and D34, 
pixel data on the original pixels D02, D11, D12, D13, D14, D22, D23, D24, D25, and D34 are respectively taken as 
d02, d11 , d12, d13, d14, d22, d23, d24, d25, and d34, p1 and p2 are taken as predetermined factors, and the pixel 
data in the settable range S found at the third step is taken as x, an equation for calculating the correlation value L 
corresponding to the set is expressed by the following equations (7): 

L = Id12-xl + Id24-xl + 01 . H1 - p2 - V1 
H1 = MAX{(ld11-d12l + Id12-d13l), (Id23-d24l + Id24-d25l)} 

V1 = MIN{(ld02-d12l + Id12-d22l), (Id14-d24l + Id24-d34l)} (7) 

[0020] Used as the fifth step is one comprising the steps of selecting the minimum of the minimum correlation values 
found for the sets at the fourth step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and determining, when there are a plurality of minimums of 
the minimum correlation values, the average of the pixel data on the interpolated pixel in a case where the minimums 
of the minimum correlation values are respectively given as the pixel data on the interpolated pixel. 
[0021] Used as the fifth step is one comprising the steps of selecting the minimum of the minimum correlation values 
found for the sets at the fourth step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 



EP1 173 017 A1 



values is given as the pixel data on the interpolated pixel, and extracting, when there are a plurality of minimums of 
the minimum correlation values, the maximum and the minimum of the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values are respectively given, and determining the average of the 
extracted maximum and minimum as the pixel data on the interpolated pixel. 

[0022] Used as the fifth step is one comprising the steps of selecting the minimum of the minimum correlation values 
found for the sets at the fourth step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and selecting, when there are a plurality of minimums of the 
minimum correlation values, the pixel data obtained from opposed pixels in closest proximity to the interpolated pixel 
out of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 
respectively given, and determining, when the number of the selected pixel data is one, the pixel data as the pixel data 
on the interpolated pixel, while determining, when the number of the selected pixel data is two, the average of the pixel 
data as the pixel data on the interpolated pixel. 

[3] Description of Third Image Interpolating Method According to Present Invention 

[0023] In an image interpolating method for interpolating a pixel at a central position among four original pixels com- 
prising a first original pixel and a second original pixel which are adjacent to each other on the right and left sides, a 
third pixel adjacent to the first original pixel on the lower side, and a fourth pixel adjacent to the second original pixel 
on the lower side, a third image interpolating method according to the present invention is characterized by comprising 
a first step of calculating a first edge component forjudging whether or not an interpolated pixel exists in the vicinity 
of an edge position of original image data on the basis of pixel data on the first original pixel, the fourth original pixel, 
a fifth original pixel on an extension of a line connecting the first original pixel and the fourth original pixel and adjacent 
to the first original pixel diagonally to the upper left, and a sixth original pixel on the extension of the line connecting 
the first original pixel and the fourth original pixel and adjacent to the fourth original pixel diagonally to the lower right; 
a second step of calculating a second edge component for judging whether or not the interpolated pixel exists in the 
vicinity of the edge position of the original image data on the basis of pixel data on the second original pixel, the third 
original pixel, a seventh original pixel on an extension of a line connecting the second original pixel and the third original 
pixel and adjacent to the second original pixel diagonally to the upper right, and an eighth original pixel on the extension 
of the line connecting the second original pixel and the third original pixel and adjacent to the third original pixel diag- 
onally to the lower left; a third step of finding a first range where pixel data on the interpolated pixel is settable on the 
basis of the first edge component and the pixel data on the first and fourth original pixels and a second range where 
the pixel data on the interpolated pixel is settable on the basis of the second edge component and the pixel data on 
the second and third original pixels; a fourth step of judging whether or not portions which are overlapped with each 
other exist in the first settable range and the second settable range; a fifth step of calculating, when there exist no 
portions which are overlapped with each other in the first settable range and the second settable range, the average 
of the pixel data on the first to fourth original pixels, and determining the result of the calculation as the pixel data on 
the interpolated pixel; a sixth step of setting, when there exist portions which are overlapped with each other in the first 
settable range and the second settable range, the overlapped portions as a settable range, then selecting a plurality 
of sets of opposed pixels between which the interpolated pixel is sandwiched diagonally, and finding, for each of the 
sets, the pixel data on the interpolated pixel in a case where a correlation value represented by the sum of the absolute 
values of the differences between the pixel data on the interpolated pixel and pixel data on the opposed pixels is the 
minimum in the range where the pixel data on the interpolated pixel is settable and the minimum correlation value; and 
a seventh step of finding the pixel data on the interpolated pixel on the basis of the pixel data on the interpolated pixel 
in the case where the correlation value is the minimum and the minimum correlation value which are found for each 
of the sets at the sixth step. 

[0024] Letting d1 be the pixel data on the first original pixel, 64 be the pixel data on the fourth original pixel, d5 be 
the pixel data on the fifth original pixel, d6 be the pixel data on the sixth original pixel, and EL be a first edge component, 
the first edge component EL is calculated on the basis of the following equation (8) at the first step. Further, letting d2 
be the pixel data on the second original pixel, d3 be the pixel data on the third original pixel, d7 be the pixel data on 
the seventh original pixel, d8 be the pixel data on the eighth original pixel, and ER be a second edge component, the 
second edge component ER is calculated on the basis of the following equation (9) at the second step. 



EL = -d5 + d1 + d4 - d6 



(8) 
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ER = -d7 + 62 + d3 - d8 (9) 

[0025] Letting EL be the first edge component, ER be the second edge component, Th be a predetermined threshold, 
dL max be tne larger one of the pixel data on the first original pixel and the pixel data on the fourth original pixel, dL min 
be the smaller one of them, dL be dL max -dL mln , dR max be the larger one of the pixel data on the second original pixel 
and the pixel data on the third original pixel, dR mjn be the smaller one of them, and dR be dR max -dR mln , a first settable 
range SL and a second settable range SR are respectively found on the basis of the following expressions (10) and 
(11) at the third step: 

if EL > Th, then dL mjn + dL/2 ^ SL ^ dL max , 
if -Th iELs Th, then dL mjn + dL74 ^ SL ^ dL max - dL74, and 

if EL < -Th, then dL mln ^ SL ^ dL min + dU2 (10) 

if ER > Th, then dR mjn + dR/2 ^ SR ^ dR max , 
if -Th ^ ER ^ Th, then dR min + dR/4 ^ SR ^ dR max - dR/4, and 

if ER < -Th, then dR min ^ SR ^ dR m}n + dR/2 (11) 

[0026] Letting x be the pixel data in the settable range S set at the sixth step, and da and db be respectively the pixel 
data on the two original pixels composing one set of opposed pixels, a correlation value L corresponding to the set is 
calculated by the following equation (12): 

30 L = Ida-xl + Idb-xl (12) 

[0027] Used as the seventh step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the sixth step , extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in acase where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and determining, when there are a plurality of minimums of 
the minimum correlation values, the average of the pixel data on the interpolated pixel in a case where the minimums 
of the minimum correlation values are respectively given as the pixel data on the interpolated pixel. 
[0028] Used as the seventh step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the sixth step , extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and extracting, when there are a plurality of minimums of 
the minimum correlation values, the maximum and the minimum of the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values are respectively given, and determining the average of the 
extracted maximum and minimum as the pixel data on the interpolated pixel. 

[0029] Used as the seventh step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the sixth step, extracting the pixel data on the interpolated pixel in a case where the selected 
minimum of the minimum correlation values is given, determining, when the number of minimums of the minimum 
correlation values is one, the pixel data on the interpolated pixel in a case wherethe minimum of the minimum correlation 
values is given as the pixel data on the interpolated pixel, and selecting, when there are a plurality of minimums of the 
minimum correlation values, the pixel data obtained from opposed pixels in closest proximity to the interpolated pixel 
out of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 
respectively given, and determining, when the number of the selected pixel data is one, the pixel data as the pixel data 
on the interpolated pixel, while determining, when the number of the selected pixel data is two, the average of the pixel 
data as the pixel data on the interpolated pixel. 
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[4] Description of Fourth Image Interpolating Method According to Present Invention 

[0030] In an image interpolating method for interpolating a pixel at a central position among four original pixels com- 
prising a first original pixel and a second original pixel which are adjacent to each other on the right and left sides, a 

5 third pixel adjacent to the first original pixel on the lower side, and a fourth pixel adjacent to the second original pixel 
on the lower side, a fourth image interpolating method according to the present invention is characterized by comprising 
a first step of calculating a first edge component forjudging whether or not an interpolated pixel exists in the vicinity 
of an edge position of original image data on the basis of pixel data on the first original pixel, the fourth original pixel, 
a fifth original pixel on an extension of a line connecting the first original pixel and the fourth original pixel and adjacent 

10 to the first original pixel diagonally to the upper left, and a sixth original pixel on the extension of the line connecting 
the first original pixel and the fourth original pixel and adjacent to the fourth original diagonally to the lower right; a 
second step of calculating a second edge component forjudging whether or not the interpolated pixel exists in the 
vicinity of the edge position of the original image data on the basis of pixel data on the second original pixel, the third 
original pixel, a seventh original pixel on an extension of a line connecting the second original pixel and the third original 

*5 pixel and adjacent to the second original pixel diagonally to the upper right, and an eighth original pixel on the extension 
of the line connecting the second original pixel and the third original pixel and adjacent to the third original pixel diag- 
onally to the lower left; a third step of respectively correcting the calculated first and second edge components on the 
basis of predetermined pseudo noise components; a fourth step of finding a first range where pixel data on the inter- 
polated pixel is settable on the basis of a first edge component after the correction and the pixel data on the first and 

20 fourth original pixels and a second range where the pixel data on the interpolated pixel is settable on the basis of a 
second edge component after the correction and the pixel data on the second and third original pixels; a fifth step of 
judging whether or not portions which are overlapped with each other exist in the first settable range and the second 
settable range; a sixth step of calculating, when there exist no portions which are overlapped with each other in the 
first settable range and the second settable range, the average of the pixel data on the first to fourth original pixels, 

25 and determining the result of the calculation as the pixel data on the interpolated pixel; a seventh step of setting, when 
there exist portions which are overlapped with each other in the first settable range and the second settable range, the 
overlapped portions as a settable range, then selecting a plurality of sets of opposed pixels between which the inter- 
polated pixel is sandwiched diagonally, and finding, for each of the sets, the pixel data on the interpolated pixel in a 
case where a correlation value represented by the sum of the absolute values of the differences between the pixel 

30 data on the interpolated pixel and pixel data on the opposed pixels and pixel data on original pixels in the vicinity of 
the opposed pixels is the minimum in the range where the pixel data on the interpolated pixel is settable and the 
minimum correlation value; and an eighth step of finding the pixel data on the interpolated pixel on the basis of the 
pixel data on the interpolated pixel in the case where the correlation value is the minimum and the minimum correlation 
value which are found for each of the sets. 

35 [0031] Letting d1 be the pixel data on the first original pixel, 64 be the pixel data on the fourth original pixel, d5 be 
the pixel data on the fifth original pixel, and d6 be the pixel data on the sixth original pixel, and EL be a first edge 
component, the first edge component EL is calculated on the basis of the following equation (13) at the first step. 
Further, letting d2 be the pixel data on the second original pixel, d3 be the pixel data on the third original pixel, d7 be 
the pixel data on the seventh original pixel, and d8 be the pixel data on the eighth original pixel, and ER be a second 

40 edge component, the second edge component ER is calculated on the basis of the following equation (1 4) at the second 
step: 

EL = -d5 + d1 +d4-d6 (13) 

45 

ER = -d7 + d2 + d3-d8 (14) 

[0032] Letting Q be a pseudo noise component, EL be the first edge component, and ER be the second edge com- 
50 ponent, a first edge component EL1 after the correction and a second edge component ER1 after the correction which 
are found at the third step are respectively given by the following expressions (15) and (16): 

if -Q ^ EL ^ Q, then EL1 = 0, and 

55 

if EL > Q or EL < -Q, then EL1 = EL (15) 
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if -Q ^ ER g Q, then ER1 = 0, and 

if ER > Q or ER < -Q, then ER1 = ER (1 6) 

5 

[0033] Letting EL1 be the first edge component after the correction, ER1 be the second edge component after the 
correction, dL max be the larger one of the pixel data on the first original pixel and the pixel data on the fourth original 
pixel, dl_ min be the smaller one of them, dl_c be the average of dL max and dL min , dR max be the larger one of the pixel 
data on the second original pixel and the pixel data on the third original pixel, dR mln be the smaller one of them, dRc 
10 be the average of dR max and dR mjn , and a and y be previously set factors, a first settable range SL and a second 
settable range SR are respectively found on the basis of the following expressions (1 7) and (1 8) at the fourth step: 



15 
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if EL1 ^ 0, then dL mjn . a + dl_c(1-a) ^ SL ^ dL max • a + dLc(1 - a) + EL1 • y, and 

if EL1 < 0, then dL mln ■ a + dLc(1 -a) + EL1 y ^ SL=i dL max • a + dLc(1 -a) (1 7) 

if ER1 ^ 0, then dR min • a + dRc (1-ct) ^ SR ^ dR max a + dRc(1-a) + ER1 . y, and 

if ER1 < 0, then dR min - a + dRc(1-a) + ER1 • y ^ SR^ dR max . a + dRc(1-a) (18) 

[0034] Letting x be the pixel data in the settable range S set at the seventh step, and da and db be respectively the 
pixel data on the two original pixels composing one set of opposed pixels, a correlation value L corresponding to the 
set is calculated by the following equation (1 9): 

L = Ida-xl + Idb-xl (19) 

[0035] Used as the eighth step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the seventh step, extracting the pixel data on the interpolated pixel in a case where the 
selected minimum of the minimum correlation values is given, determining, when the number of minimums of the 
minimum correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum 
correlation values is given as the pixel data on the interpolated pixel, and determining, when there are a plurality of 
minimums of the minimum correlation values, the average of the pixel data on the interpolated pixel in a case where 
the minimums of the minimum correlation values are respectively given as the pixel data on the interpolated pixel. 
[0036] Used as the eighth step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the seventh step, extracting the pixel data on the interpolated pixel in a case where the 
selected minimum of the minimum correlation values is given, determining, when the number of minimums of the 
minimum correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum 
correlation values is given as the pixel data on the interpolated pixel, and extracting, when there are a plurality of 
minimums of the minimum correlation values, the maximum and the minimum of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum correlation values are respectively given, and determining the average 
of the extracted maximum and minimum as the pixel data on the Interpolated pixel. 

[0037] Used as the eighth step is one comprising the steps of selecting the minimum of the minimum correlation 
values found for the sets at the seventh step, extracting the pixel data on the interpolated pixel in a case where the 
selected minimum of the minimum correlation values is given, determining, when the number of minimums of the 
minimum correlation values is one, the pixel data on the interpolated pixel in a case where the minimum of the minimum 
correlation values is given as the pixel data on the interpolated pixel, and selecting, when there are a plurality of 
minimums of the minimum correlation values, the pixel data obtained from opposed pixels in closest proximity to the 
interpolated pixel out of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation 
values are respectively given, and determining, when the number of the selected pixel data is one, the pixel data as 
the pixel data on the interpolated pixel, while determining, when the number of the selected pixel data is two, the 
average of the pixel data as the pixel data on the interpolated pixel. 
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<Brief Description of Drawings> 
[0038] 

5 Fig. 1 is a schematic view showing the relationship between original pixels and an interpolated pixel. 

Fig. 2 is a flow chart showing the procedure for a first image interpolating method. 

Fig. 3 is a graph of an edge component E against a range S where pixel data x on an interpolated pixel X is settable. 
Fig. 4 is a graph of a correlation value L against pixel data x. 

Figs. 5(a) to 5(f) are graphs of a correlation value L against pixel data x and schematic views showing a range S 
10 where pixel data is settable. 

Fig. 6 is a schematic view showing the relationship between original pixels and an interpolated pixel. 

Fig. 7 is a block diagram showing the configuration of a first image interpolating device. 

Fig. 8 is a block diagram showing the configuration of a second image interpolating device. 

Fig. 9 is a schematic view for explaining the advantage of the first image interpolating method. 
15 Fig. 10 is a flow chart showing the procedure for a second image interpolating method. 

Fig. 11 is a schematic view showing the relationship between original pixels and an interpolated pixel. 

Fig. 12 is a graph of an edge component E against an edge component E1 after correction. 

Figs. 13(a) and 13(b) are schematic views showing a range S where pixel data x on an interpolated pixel X is 

settable. 

20 Fig. 14 is a graph of a correlation value L against pixel data x. 

Fig. 15 is a schematic view showing the relationship between original pixels and an interpolated pixel. 

Fig. 1 6 is a schematic view for explaining the advantage of the second image interpolating method. 

Fig. 1 7 is a schematic view for explaining the advantage of the second image interpolating method. 

Fig. 1 8 is a schematic view showing the relationship between original pixels and an interpolated pixel. 
25 Fig. 1 9 is a flow chart showing the procedure for a third image interpolating method. 

Figs. 20(a) and 20(b) are schematic views showing the relationship between a first settable range SL and a second 

settable range SR. 

Fig. 21 is a flow chart showing the procedure for a fourth image interpolating method. 
30 <Best Mode for Carrying Out the lnvention> 

[0039] Referring now to the drawings, embodiments of the present invention will be described. 
[1] Description of First Image Interpolating Method 

35 

[0040] Referring now to Figs. 1 to 6, the outline of a first image interpolating method will be described. A two-dimen- 
sional image has a two-dimensional expanse in the horizontal direction and the vertical direction. In the schematic 
description of the first image interpolating method described below, however, a method of one-dimensional interpolation 
in the vertical direction will be described in order to simplify the description. 
40 [0041] Fig. 1 illustrates the relationship between original pixels and a pixel to be interpolated. 

[0042] In Fig. 1, lines (n-1), n, (n+1), and (n+2) are horizontal lines in an original image, and lines (i-1), i, and (i+1) 
are horizontal lines to be interpolated. 

[0043] Description is now made of a case where a pixel (hereinafter referred to as an interpolated pixel) X on the 
line i is interpolated. Let D12 be an original pixel just above the interpolated pixel X, and D22 be an original pixel just 
^5 below the interpolated pixel X. Let D11 and D13 be respectively original pixels adjacent to the original pixel D12. Let 
D21 and D23 be respectively original pixels adjacent to the original pixel D22. Further, let D02 be an original pixel just 
above the original pixel D12, and D32 be an original pixel just below the original pixel D22. 

[0044] In the following description, pixel data on the original pixels D11, D12, D13, D21, D22, D23, D02, and D32 
and the interpolated pixel X are respectively denoted by d11, d12, d13, d21, d22, d23, d02, and d32 and x. In this 
so example, the pixel data shall be composed of eight bits, black data shall be "0", and white data shall be "255". 

[0045] Fig. 2 shows the procedure forf inding the pixel data x on the interpolated pixel X by the first image interpolating 
method. 

[0046] First, an edge component E is calculated in order to judge whether or not the interpolated pixel X exists in 
the vicinity of an edge of an original image (step 1 ). That is, the edge component E is found from the following equation 
55 (20) using the pixel data on the two original pixels D02 and D12 just above the interpolated pixel X and the original 
pixels D22 and D23 just below the interpolated pixel X: 
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E = -d02 + d1 2 + d22 - d32 (20) 

[0047] When the interpolated pixel X exists in the vicinity of a black edge of the original image, the edge component 
s E takes a relatively large negative value. When the interpolated pixel X exists in the vicinity of a white edge of the 
original image, the edge component E takes a relatively large positive value. 

[0048] A range where the pixel data x on the interpolated pixel X is settable is then determined (step 2). That is, the 
range where the pixel data x on the interpolated pixel X is settable is determined, as shown in Fig. 3, on the basis of 
the edge component E found at the step 1 . In Fig. 3, d max denotes the larger one of the pixel data d1 2 and d22 on the 
10 original pixels D1 2 and D22, and d m{n denotes the smaller one of the pixel data d1 2 and d22 on the original pixels D1 2 
and D22. d denotes the difference (d max -d min ) between the pixel data d12 and d22 on the original pixels D1 2 and D22. 
[0049] Letting Th be a previously set threshold, the relationship between the edge component E and the range where 
the pixel data x on the interpolated pixel X is settable is as follows: 

*5 . the range S where the pixel data x on the interpolated pixel X is settable when E > Th 

d min + (d/2) ^ S ^ d max 

20 [0050] In this case, it is presumed that the interpolated pixel X exists in the vicinity of the white edge of the original 
image, and the settable range S is set to a range near d max in the range of d mjn to d max . 

the range S where the pixel data x on the interpolated pixel X is settable when -Th ^ E ^ Th 



25 



30 



50 



d min + (d/4) ^ S ^ d max - (d/4) 
the range S where the pixel data x on the interpolated pixel X is settable when E < -Th 

d min S S == d min + (d/2) 



[0051] In this case, it is presumed that the interpolated pixel X exists in the vicinity of the black edge of the original 
image, and the settable range S is set to a range near d max in the range of d min to d max . 

35 [0052] Candidates for the pixel data on the interpolated pixel X are then found from the range S where the pixel data 
x on the interpolated pixel X is settable on the basis of pixel data on opposed pixels between which the interpolated 
pixel X is sandwiched diagonally (step 3). That is, the respective minimums L mln and R mln of two diagonal correlation 
values L and R and pixel data xl and xr in a case where the minimums are respectively given are found from the range 
S where the pixel data x on the interpolated pixel X is settable, as described below. 

40 [0053] There are two methods of finding the candidates for the pixel data on the interpolated pixel X. The methods 
will be described. 

(1 ) Description of First Method 

45 [0054] All pixel data x in the settable range S are respectively substituted in the following equation (21) expressing 
a correlation value L between the pixel data on the two opposed pixels D11 and D23 between which the interpolated 
pixel X is sandwiched diagonally (diagonally to the upper left) and the pixel data on the interpolated pixel X, to find the 
minimum correlation value L mjn and pixel data xl in a case where the minimum correlation value is given: 



L= Id11-xl + ld23-xl (21) 



[0055] Similarly, all the pixel data x in the settable range S are respectively substituted in the following equation (22> 
expressing a correlation value R between the pixel data on the two opposed pixels D13 and D21 between which the 
55 interpolated pixel X is sandwiched diagonally (diagonally to the upper right) and the pixel data on the interpolated pixel 
X, to find the minimum correlation value R mjn and pixel data xr in a case where the minimum correlation value R min is 
given: 
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R=ld13-xl + ld21-xl (22) 

[0056] In such a manner, the found pixel data xl and xr are candidates for the pixel data on the interpolated pixel X. 
5 In such a method, however, a plurality of pixel data may, in some cases, be applicable as the pixel data xl in a case 
where the minimum correlation value L mln is given. Similarly, a plurality of pixel data may, in some cases, be applicable 
as the pixel data xr in a case where the minimum correlation value R mln is given. 

[0057] When a plurality of pixel data are applicable as the pixel data xl in a case where the minimum correlation 
value L min is given, the average of the pixel data may be determined as the pixel data xl in the case where the minimum 
10 correlation value L min is given. Similarly, when a plurality of pixel data are applicable as the pixel data xr in the case 
where the minimum correlation value R min is given, the average of the pixel data may be determined as the pixel data 
xr in the case where the minimum correlation value R mln is given. 



15 



(2) Description of Second Method 



[0058] Fig. 4 illustrates the relationship between the correlation value L and the pixel data x. In Fig. 4, x mjn denotes 
the smaller one of the pixel data d11 and d23 on the opposed pixels D11 and D23, and x max denotes the larger one of 
the pixel data d11 and d23. xd denotes the difference (x max -x min ) between the pixel data d11 and d23. 
[0059] The foregoing equation (21 ) can be changed, as expressed by the following equations (23), from the relation- 
20 ship between the correlation value L and the pixel data x shown in Fig. 4. 

L = xd + 2(x-x max ) (x > x max ) 

25 L = Xd ( X min ^ * ^ X max) 

L = xd + 2 (x mjn -x) (x < x mjn ) (23) 

[0060] Although only equations for changing the correlation value L are shown, the correlation value R expressed 
30 by the foregoing equation (22) can be similarly changed. 

[0061] Description is now made of a method of finding minimum correlation values L mfn and R min and pixel data xl 
and xr (a second method). Description is herein made of a method of finding the minimum correlation value L m[n and 
the pixel data xl. 

[0062] Figs. 5(a>to 5(f) show graphs of the correlation value L against the pixel data x and a range where the pixel 
35 data x is settable. 

[0063] In Fig. 5, xa denotes the minimum of the pixel data x in the settable range, and xb denotes the maximum of 
the pixel data x in the settable range. 

• in the case of xb ^ x mjn 

[0064] When the range where the pixel data x is settable is not more than x min , as shown in Fig. 5 (a) , the correlation 
40 value L is the minimum in the pixel data xb. Accordingly, the minimum correlation value L min is xd + 2(x mln -xb). Further, 
the pixel data xl at this time is xb. 

• in the case of x max ^ xa 

[0065] When the range where the pixel data x is settable is not less than x max , as shown in Fig. 5 (b), the correlation 
value L is the minimum in the pixel data xa. Consequently, the minimum correlation value L min is xd + 2(xa-x max ). 

45 Further, the pixel data xl at this time is xa. 

■ in the case of x mln ^ xa and xb ^ x max 
[0066] When the range where the pixel data x is settable is between the pixel data x mjn and x max , as shown in Fig. 
5 (c), the correlation value L is the minimum xd in arbitrary pixel data x in the settable range. Consequently, the minimum 
correlation value L min is xd. In this case, a value (xa+xb)/2 at the center of the settable range is determined as the pixel 

so data xl. 

• in the case of xa < x mjn and x max < xb 

[0067] When the range where the pixel data x is settable is a range wider than the range of the pixel data x min to 
x max , as shown in Fig. 5 (d), the correlation value L is the minimum xd in arbitrary pixel data x in the range of the pixel 
data x m}n to x max . 

55 Consequently, the minimum correlation value L min is xd. In this case, the average (x mjn +x max )/2 of the pixel data x mln 
and x max is determined as the pixel data xl. 

• in the case of xa < x mln and x mln < xb ^ x max 
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[0068] When the range where the pixel data x is settable is shifted leftward from the range of the pixel data x mln to 
x max , as shown in Fig. 5 (e), the correlation value L is the minimum xd In arbitrary pixel data x in a range of the pixel 



50 



data x mjn to xb. 



Consequently, the minimum correlation value L min is xd. In this case, the average (x mjn +xb)/2 of the pixel data x mln and 
xb is determined as the pixel data xl. 



• in the case of x mjn ^ xa < x max and x max ^ xb 
[0069] When the range where the pixel data x is settable is shifted rightward from the range of the pixel data x mjn to 
x max , as shown in Fig. 5 (f), the correlation value L is the minimum xd in arbitrary pixel data x in a range of the pixel 
data xa to x max . 

10 Consequently, the minimum correlation value L min is xd. In this case, the average (xa+x max )/2 of the pixel data xa and 
x max is determined as the pixel data xl. 

[0070] The minimum correlation value L mjn and the pixel data xl are thus found. The minimum correlation value R min 
and the pixel data xr are also found in the same manner as the minimum correlation value and the pixel data xl. 
[0071 ] When the minimum correlation values L min and R mjn and the pixel data xl and xr in a case where the minimum 
15 correlation values are respectively given are found at the step 3, the pixel data corresponding to the smaller one of the 
minimum correlation value and R mln is extracted (step 4). 

[0072] When the minimum correlation values L min and R mjn differ from each other, one pixel data is extracted. When 
the minimum correlation values and R min are the same, two pixel data are extracted. 

[0073] When one pixel data xl or xr is extracted at the step 4 (YES at step 5), the extracted pixel data is determined 
20 as the pixel data x on the interpolated pixel X (step 6). When two (a plurality of) pixel data xl and xr are selected at the 
step 4 (NO at step 5), the average of the pixel data xl and xr is determined as the pixel data x on the interpolated pixel 
X (step 7). 

[0074] The details are as follows: 

25 . jf L mjn < R min , then x = xl 

• if Lmin > R mjni then x = xr 

* if L m in = Rmin. then x = (xl+xr)/2 

[0075] Although at the foregoing step 3, two sets are selected as the set of opposed pixels between which the inter- 
30 polated pixel X is sandwiched diagonally, two or more sets may be selected. For example, six sets of opposed pixels, 

for example, D11 and D27, D12 and D26, D13 and D25, D15 and D23, D16 and D22, and D17 and D21 may be 

selected, as shown in Fig. 6. In this case, pixel data in a case where the minimum correlation value is given is found 

at the step 3 for each of the sets of opposed pixels. That is, six candidates for the pixel data are found. 

[0076] When the number of minimums of the minimum correlation values corresponding to the six sets of opposed 
35 pixels is three or more, three or more pixel data are extracted from the six candidates for the pixel data. 

[0077] When three or more pixel data are selected at the step 4, there are three methods, as described below, as a 

method of determining the pixel data x on the interpolated pixel X. 

[0078] The first method is one for calculating the average of three or more pixel data selected at the step 4 and 
determining the result of the calculation as the pixel data x on the interpolated pixel X. The second method is one for 
40 extracting the maximum and the minimum of three or more pixel data selected at the step 4 and calculating the average 
of the maximum and the minimum, and determining the result of the calculation as the pixel data x on the interpolated 
pixel X. 

[0079] The third method is one for selecting pixel data obtained from opposed pixels in closest proximity to the 
interpolated pixel X out of three or more pixel data selected at the step 4, and determining the selected pixel data as 
45 the pixel data x on the interpolated pixel X. When there exist two pixel data obtained from the opposed pixels in closest 
proximity to the interpolated pixel X, the average of the pixel data is calculated, and the result of the calculation is 
determined as the pixel data x on the interpolated pixel X. 



[1-1] Description of Image Interpolating Device Using First Image Interpolating Method 
[1-1-1] Description of First Image Interpolating Device 



[0080] Although in the foregoing item [1], description was made of the image interpolating method in a case where 
the number of sets of diagonally opposed pixels is set to two, description is herein made of a case where the number 
55 of sets of diagonally opposed pixels is six, as described using Fig. 6. Description is made of an image interpolating 
device for performing one-dimensional interpolation in the vertical direction in order to simplify the description,. 
[0081] Fig. 7 illustrates the configuration of a first image interpolating device. 

[0082] A memory unit 1 stores pixel data on an original pixel inputted through an input terminal IN. A correlation 
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value operating unit 2 uses the pixel data on the original pixel stored in the memory unit 1 , to calculate six minimum 
correlation values L1 min to L3 min and R1 mjn to R3 min which are obtained from six sets of opposed pixels and pixel data 
x11 to x31 and x1 rto x3r in a case where the six minimum correlation values are respectively given. 
[0083] The minimum extracting unit 3 identifies the minimum correlation value which is the minimum of the six min- 
5 imum correlation values L1 min to L3 min and R1 mjn to R3 min calculated by the correlation value operating unit 2. A pixel 
data selecting unit 4 selects, out of the six pixel data x11 to x31 and x1 r to x3r which are fed from the correlation value 
operating unit 2 on the basis of the result of the identification in the minimum extracting unit 3, the pixel data which are 
candidates for pixel data on an interpolated pixel X. 

[0084] A maximum/minimum extracting unit 5 extracts the pixel data which are the maximum and the minimum of 
10 the pixel data selected by the pixel data selecting unit 4. An average operating unit 6 calculates the average of the two 

pixel data extracted in the maximum/minimum extracting unit 5, and outputs the result of the calculation to an output 

terminal OUT as the pixel data on the interpolated pixel X. 

[0085] Description is made of the operation of the image interpolating device. 

[0086] Fig. 6 illustrates the relationship between original pixels and a pixel to be interpolated. 
15 [0087] As shown in Fig. 6, original pixels D04, D11 to D17, D21 to D27, and D34 shall be arranged with respect to 

an interpolated pixel X. Pixel data on the interpolated pixel X and the original pixels D04, D1 1 to D1 7, D21 to D27, and 

D34 shall be respectively denoted by x and d04, d11 to d17, d21 to d27 t and d34. 

[0088] First, the pixel data on the four original pixels D04, D14, D24, and D34 just above and just below the interpo- 
lated pixel X are inputted from the memory unit 1 to the correlation value operating unit 2, where an edge component 
20 E is found by the following equation (24): 

E = -d04 + d1 4 + d24 - d34 (24) 

25 [0089] By the edge component E thus found, a range S where the pixel data x on the interpolated pixel X is settable 
is found by the same method as that at the step 2 shown in Fig. 2. On the basis of the following equations (25) to (30) 
respectively expressing a correlation value L1 between the pixel data on the opposed pixels Q1 1 and D27 and the pixel 
data on the interpolated pixel X, a correlation value L2 between the pixel data on the opposed pixels D12 and D26 and 
the pixel data on the interpolated pixel X, a correlation value L3 between the pixel data on the opposed pixels D13 and 

30 D25 and the pixel data on the interpolated pixel X, a correlation value R1 between the pixel data on the opposed pixels 
D17 and D21 and the pixel data on the interpolated pixel S, a correlation value R2 between the pixel data on the 
opposed pixels D16 and D22 and the pixel data on the interpolated pixel X, and a correlation value R3 between the 
pixel data on the opposed pixels D1 5 and D23 and the pixel data on the interpolated pixel X, the respective minimums 
L1 mln to L3 mln and R1 min to R3 min of the correlation values L1 to L3 and R1 to R3 and pixel data x1 1 to x3l and x1r to 

35 x3r in a case where the minimums are respectively given are found in the same method as that at the step 3 shown 
in Fig. 2. 
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L1 = ld11-xl + ld27-xl (25) 

L2 = ld12-xl + ld26-xl (26) 

L3 = ld13-xl + ld25-xl (27) 

R1 = ld17-xl + ld21-xl (28) 

R2 = Id16-xl + ld22-xl (29) 

R3 = ld15-xl + ld23-xl (30) 

[0090] When the minimums L1 min to L3 mjn and R1 min to R3 min of the correlation values L1 to L3 and R1 to R3 and 
the pixel data x1l to x3l and x1r to x3r in a case where the minimums are respectively given are thus found by the 
correlation value operating unit 2, the minimums L1 m[n to L3 mjn and R1 mm to R3 mjn are fed to the minimum extracting 
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unit 3, and the pixel data x1 1 to x3l and x1 r to x3r are fed to the pixel data selecting unit 4. 

[0091] The minimum extracting unit 3 receives the minimum correlation values L1 mjn to L3 min and R1 mln to R3 min 
and outputs Flagl to Flag6 which are control signals respectively corresponding to the inputted minimum correlation 
values L1 min to L3 min and R1 min to R3 mln . 
5 [0092] The minimum extracting unit 3 outputs the control signals Flagl to Flag6 respectively corresponding to the 
minimums L1 mln to L3 min and R1 min to R3 m[n of the correlation values L1 to L3 and R1 to R3. The control signal cor- 
responding to the smallest one of the minimums L1 mjn to L3 min and R1 min to R3 m(n of the correlation values L1 to L3 
and R1 to R3 is considered to be High, and the control signals corresponding to the other minimums are considered 
to be Low. 

w [0093] When L1 min and R2 mjn are the smallest of the minimums L1 min to L3 mjn and R1 min to R3 min , for example, the 
control signals Flagl and Flag5 are considered to be High, and the other control signals Flag2 to Flag4 and Flag6 are 
considered to be Low. The number of control signals which are High is not limited to two, as in this example. The 
number of control signals is any one of one to six. 

[0094] The control signals Flagl to Flag6 which are outputted from the minimum extracting unit 3 are fed to the pixel 
15 data selecting unit 4. In the pixel data selecting unit 4, the pixel data corresponding to the control signal which is High 

out of the control signals fed from the minimum extracting unit 3 is outputted to the maximum/minimum extracting unit 5. 

[0095] When the control signals Flagl and Flag5 fed from the minimum extracting unit 3 are High, and the other 

control signals Flag2 to Flag4 and FIag6 are Low, as in the above-mentioned example, the pixel data x1l and x2r are 

selected and are fed to the maximum/minimum extracting unit 5. 
20 [0096] In the maximum/minimum extracting unit 5, the maximum pixel data and the minimum pixel data are selected 

out of the pixel data fed from the pixel data selecting unit 4, and are fed to the average operating unit 6. In the average 

operating unit 6, the average of the two pixel data fed from the maximum/minimum extracting unit 5 is caiculated, and 

the result of the calculation is outputted to the output terminal OUT as the pixel data x on the interpolated pixel X. 

[0097] When only one of the pixel data is fed to the maximum/minimum extracting unit 5, the maximum/minimum 
25 extracting unit 5 feeds the one pixel data to the average operating unit 6. In this case, the average operating unit 6 

outputs the fed one pixel data as It is as the pixel data x on the interpolated pixel X. 

[0098] The pixel data on the original pixel is outputted to the output terminal OUT through the memory unit 1 and 
the correlation value operating unit 2. That is, after the pixel data on the original pixel on the line n is outputted, the 
pixel data on the interpolated pixel on the line i is outputted. 
30 [0099] When a threshold Th for comparing edge components in the correlation value operating unit 2 is made change- 
able in such a manner that it can be inputted from the exterior, an image to be reproduced can be subjected to most 
suitable interpolation processing. 

[0100] Although the first image interpolating device increases the number of lines, the same interpolation processing 
may be performed in the horizontal direction in order to increase the number of pixels on the line. 
35 [0101] When in Fig. 7, the maximum/minimum extracting unit 5 and the average operating unit 6 are omitted, an 
average operating unit is provided in the succeeding stage of the pixel data selecting unit 4, and a plurality of pixel 
data are selected by the pixel data selecting unit 4, the average of the pixel data may be calculated, to output the result 
of the calculation to the output terminal OUT as the pixel data x on the interpolated pixel X. 

40 [1-1-2] Description of Second Image Interpolation Device 

[0102] Fig. 8 illustrates the configuration of a second image interpolating device. 

[0103] In Fig. 8, the same units as those shown in Fig. 7 are assigned the same reference numerals and hence, the 
description thereof is not repeated. The relationship between an interpolated pixel X and original pixels shall be a 

45 relationship as shown in Fig. 6. 

[0104] The image interpolating device comprises an input terminal IN, an output terminal OUT, a memory unit 1 , a 
correlation value operating unit 2, a minimum extracting unit 3, a pixel data selecting unit 4, and an interpolated pixel 
data extracting unit 7 for extracting pixel data found from opposed pixels in closest proximity to the interpolated pixel 
X out of pixel data fed from the pixel data selecting unit 4. 

so [0105] The operations of the memory unit 1 , the correlation value operating unit 2, the minimum extracting unit 3, 
and the pixel data selecting unit 4 are the same as those of the memory unit 1 , the correlation value operating unit 2, 
the minimum extracting unit 3, and the pixel data selecting unit 4 show in Fig. 7. 

[0106] Minimum correlation values L1 mjn to L3 mjn and R1 min to R3 min and pixel data x1l to x3l and x1r to x3r are 
found in the correlation value operating unit 2. The minimum correlation values L1 min to L3 mln and R1 mjn to R3 min are 
55 fed to the minimum extracting unit 3, and the pixel data x1 1 to x3l and x1 r to x3r are fed to the pixel data selecting unit 4. 
[0107] Control signals Flagl to Flag6 respectively corresponding to the minimum correlation values L1 mjn to L3 min 
and R1 mjn to R3 min are outputted from the minimum extracting unit 3. In the pixel data selecting unit 4, the pixel data 
corresponding to the control signal which is High is selected from the pixel data x1 1 to x3l and x1 r to x3r and is fed to 
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the interpolated pixel data extracting unit 7. 

[0108] The interpolated pixel data extracting unit 7 extracts the pixel data obtained from the set of opposed pixels 
in closest proximity to the interpolated pixel X out of the pixel data fed by the pixel data selecting unit 4, and outputs 
the pixel data to the output terminal OUT as pixel data x on the interpolated pixel X. In this case, when the number of 
5 extracted pixel data is two, the average of the pixel data is calculated, and the result of the calculation is outputted to 
the output terminal OUT as the pixel data x on the interpolated pixel X. 

[0109] When the pixel data selected by the pixel data selecting unit 4 are x1 1, x2l, and x1r, for example, the pixel 
data obtained from the set of opposed pixels in closest proximity to the interpolated pixel X is the pixel data x21 obtained 
from opposed pixels D12 and D26. Accordingly, the pixel data x21 is outputted to the output terminal OUT as the pixel 

10 data x on the interpolated pixel X. 

[0110] When the pixel data selected by the pixel data selecting unit 4 are x1 1, x2l, and x2r, the pixel data obtained 
from the set of opposed pixels in closest proximity to the interpolated pixel X are the pixel data x2l obtained from the 
opposed pixels D12 and D26 and the pixel data x2r obtained from opposed pixels D16 and D22. Accordingly, the 
average (x2l+x2r)/2 of the pixel data x2l and x2r is outputted to the output terminal OUT as the pixel data x on the 

*5 interpolated pixel X. 

[0111] The pixel data on the original pixel is outputted to the output terminal OUT through the memory unit 1 and 
the correlation value operating unit 2. That is, the pixel data on the original pixel on the line n is outputted, and the 
pixel data on the interpolated pixel on the line i is then outputted. 

[0112] The second image interpolating device increases the number of lines. In order to increase the number of 
20 pixels on the line, however, the same interpolation processing may be performed in the horizontal direction. 

[0113] In the first image interpolating method, after a range where the pixel data on the interpolated pixel is settable 
is determined on the basis of an edge component E, candidates for the pixel data on the interpolated pixel are extracted 
on the basis of diagonal correlation values. The advantage that the range where the pixel data on the interpolated pixel 
is settable is determined will be described using Fig. 9. in Fig. 9, a black circle indicates an original pixel represented 
25 by black data, and a white circle indicates an original pixel represented by white data. X denotes the interpolated pixel. 
In the description of Fig. 9, the white data shall be "1 " and the black data shall be "0" in order to simplify the description. 
[0114] When there is a black thin line in a white background, as shown in Fig. 9, it is preferable that the pixel data 
on the interpolated pixel X is taken as the black data "0". 

[0115] Description is made of a case where the candidates for the pixel data on the interpolated pixel are extracted 
30 on the basis of the diagonal correlation values without determining the range where the pixel data on the interpolated 
pixel is settable. In this case, the minimum of a correlation value (Id13-xl + Id25-xl) corresponding to opposed pixels 
D13 and D25 is 11-11 + 11-11 = 0, and the pixel data x in a case where the minimum correlation value is given is 1. 
Further, the minimum of a correlation value (Id15-xl + Id23-xl) corresponding to opposed pixels D15 and D23 is I0-0I 
+ I0-0I = 0, and the pixel data x in a case where the minimum correlation value is given is 0. Consequently, the pixel 
35 data x on the interpolated pixel X is (1+0)/2 = 0.5, and is not black data. 

[0116] Description is made of a case where the range where the pixel data on the interpolated pixel is settable is 
determined as in the first image interpolating method, and the candidates for the pixel data on the interpolated pixel 
are extracted on the basis of diagonal correlation values. In this case, an edge component E (= -d04 + d14 + d24 - 
d34) is -1 + 0 + 1 - 1 = -1 , and the range where the pixel data x on the interpolated pixel X is settable is 0 i x i 0.5. 
40 [0117] When the minimum of a correlation value corresponding to the opposed pixels D13 and D25 is found in the 
settable range, 11-0.51 + 11-0.51 = 1 , and the pixel data x in a case where the minimum correlation value is given is 0.5. 
Further, the minimum of a correlation value corresponding to the opposed pixels D15 and D23 is I0-0I + I0-0I = 0, and 
the pixel data x in a case where the minimum correlation value is given is 0. Consequently, the pixel data x on the 
interpolated pixel X is 0. 

45 

[2] Description of Second Image Interpolating Method 

[01 1 8] Description is made of a second image interpolating method. A two-dimensional image has two-dimensional 
expanse in the horizontal direction and the vertical direction. However, a method of one-dimensional interpolation in 
50 the vertical direction will be described in order to simplify the description. 

[0119] Fig. 10 shows the procedure for image interpolation processing by the second image interpolating method. 
[0120] Description is herein made of a method of finding pixel data on an interpolated pixel X on a line i between a 
line n and a line (n+1) and between an original pixel D13 on the line n and an original pixel D23 on the line (n+1), as 
shown in Fig. 11 . 

55 [0121] First, an edge component E is calculated in order to judge whether or not the interpolated pixel X exists in 
the vicinity of an edge of an original image (step 11). That is, the edge component E is found from the following equation 
(31) using pixel data on two original pixels D03 and D13 just above the interpolated pixel X and original pixels D23 
and D33 just below the interpolated pixel X: 
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E = -d03 + d13 + d23 - d33 (31) 

[0122] It is then judged whether or not the edge component E is within a range of -Q ^ E ^ Q, letting N be a pseudo 
5 noise component previously set (step 12). The pseudo noise component Q is a variable which can be controlled from 
the exterior. 

[0123] The edge component E is corrected on the basis of the result of the judgment. That is, letting E1 be an edge 
component after the correction, the edge component E1 after the correction is set to zero when the edge component 
E is within the range of -Q ^ E ^ Q (step 13). 
10 [01 24] When the edge component E is outside the range of -Q ^ E ^ Q, that is, E < -Q or E > Q, the edge component 
E1 after the correction is set to E (step 14). 

[0125] Consequently, the relationship between the edge component E and the edge component E1 after the correc- 
tion is expressed by the following equations 32, and is expressed by a graph as shown in Fig. 12: 

15 E1 - 0 (-Q ^ E ^ Q) 

E1 = E (E > Q or E < -Q) (32) 

20 [0126] The edge component E is thus corrected using the pseudo noise component Q, thereby reducing the effect 
of noises appearing in the edge component E. 

[0127] A range S where pixel data x on the interpolated pixel X is settable is then determined on the basis of the 
edge component E1 after the correction (step 15). 

[0128] Description is made of a method of determining the settable range S on the basis of Fig. 13. In Fig. 13, d max 
25 denotes the larger one of pixel data d13 and d23 on the original pixels D13 and D23, and d min denotes the smaller one 
of the pixel data d1 3 and d23 . dc denotes the average (d max +d m[n ) 12 of d max and d mjn . 

(1) Range S Where Pixel Data x is Settable When E1 ^ 0 

30 [0129] As shown in Fig. 13 (a), d mjn x a + dc x (1-a) ^ S ^ d max xa + dcx (1-a) + E1 xy, where a and y are 
variables which can be controlled from the exterior. 

[0130] That is, when the edge component E1 is not less than zero, the range S where the pixel data x is settable is 
a range expanded upward by the value of y • E1 from a range centered around dc [d mln x a + dc x (1 - a) ^ x ^ d max 
xa + dcx (1-<x)]. 

35 

(2) Range S Where Pixel Data x is Settable When E1 < 0 

[0131] As shown in Fig. 13 (b), d mln x a + dc x (1-a) + E1 xy^Si d max xa+dcx (1-a). 
[0132] That is, when the edge component E1 is less than zero, the range S where the pixel data x is settable is a 
40 range expanded downward by the value of y • E1 from a range centered around dc [d min xa + dcx(1-a)^xi d max 
x a + dc x (1-a)]. 

[01 33] Candidates for the pixel data on the interpolated pixel X are then found from the range S where the pixel data 
x on the interpolated pixel X is settable on the basis of pixel data on opposed pixels between which the interpolated 
pixel X is sandwiched diagonally (step 16). 
45 [0134] Although a method of finding the candidates for the pixel data on the interpolated pixel X is approximately the 
same as that at the step 3 shown in Fig. 2, equations for finding correlation values L and R differ from those at the step 
3 shown in Fig. 2. 

[0135] A correlation value L between pixel data on opposed pixels D12 and D24 and the pixel data on the interpolated 
pixel X is expressed by the following equation (33), and a correlation value R between pixel data on opposed pixels 
so D14 and D22 and the pixel data on the interpolated pixel X is expressed by the following equation (34) : 

L = Id12-xl + Id24-xl + p1 x H1 - p2 x V1 •« (33) (33) 

55 R = Id14-xl + Id22-xl + p1 xHr-p2xVr - (34) (34) 

[0136] In the foregoing equation (33) and (34), p1 and P2 are variables which can be controlled from the exterior. 
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[0137] H1 denotes the larger one of an amount of change H11 of amounts d 11 to d1 3 found by the following equation 
(35) and an amount of change H12 of amounts d23 to d25 found by the following equation (36) . That is, H1 = MAX 
(H11 , H12). MAX(a, b) is a sign indicating that the larger one of a and b is selected. 

[0138] V1 denotes the smaller one of an amount of change V11 of d02 to d22 found by the following equation (37) 
and an amount of change V12 of d14 to d34 found by the following equation (38). That is, V1 = MIN(V11, V12). MIN 
(a, b) is a sign indicating that the smaller one of a and b is selected. 

H11 = Id11-d12l + ld12-d13l (35) 
H1 2 = Id23-d24l + Id24-d25l (36) 
V1 1 = Id02-d12l + Id12-d22l (37) 

V1 2 = Id1 4-d24l + Id24-d34l (38) 

[0139] Hr denotes the larger one of an amount of change Hr of d13 to d15 found by'the following equation (39) and 
an amount of change Hr2 of d21 to d23 found by the following equation (40). That is, Hr = MAX(Hr1 , Hr2). 
[0140] Vr denotes the smaller one of an amount of change Vr1 of d12 to d32 found by the following equation (41) 
and an amount of change Vr2 of d04 to d24 found by the following equation (42). That is, Vr = MIN(Vr1 , Vr2). 

Hr1 = Id13-d14l + Id14-d15l (39) 
Hr2 = Id21 -d22l + Id22-d23l (40) 
Vr1 = Id1 2-d22l + Id22-d32l (41) 

Vr2 = Id04-d14l + Id14-d24l (42) 

[0141] Fig. 1 4 illustrates the relationship between the correlation value Land the pixel data x. In Fig. 14, x mln denotes 
the smaller one of the pixel data d12 and d24, and x max denotes the larger one of the pixel datad12 and d24. Further, 
xd = x max - x min + pi xH1 -P2XV1. 

[0142] When xd = x max - x min + p1 x H1 - p2 x V1 , the correlation value L expressed by the foregoing equation (33) 
can be changed, as in the following equations (43). The correlation value R can be similarly changed: 

L = xd + 2 (x-x max ) (x > x max ) 

L = xd ( x min £ x 2i x max) 

L = xd + 2 (x mjn -x) (x < x min ) (43) 

[0143] Minimum correlation values L min and R min and pixel data xl and xr can be found in the method described in 
the second method at the step 3 shown in Fig. 2, that is, the same method as the method described using Fig. 5. In 
this case, xd in the graph shown in Fig. 5 indicates x,^ - x min + pi x H1 - p 2 x V1 . 

[01 44] When the minimum correlation values L mln and R mjn and the pixel data xl and xr in a case where the minimum 
correlation values are respectively given are found at the step 16, the pixel data corresponding to the smaller one of 
the minimum correlation values and R mln is extracted (step 17). 

[01 45] When the minimum correlation values L mln and R min differ from each other, one pixel data is extracted. When 
the minimum correlation values L mjn and R min are the same, two pixel data are extracted. 

[01 46] When one pixel data xl or xr is extracted at the step 1 7 (YES at step 1 8), the extracted pixel data is determined 
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as the pixel data x on the interpolated pixel X (step 19). When two (a plurality of) pixel data xl and xr are selected at 
the step 1 7 (NO at step 1 8), the average of the pixel data xl and xr is determined as the pixel data x on the interpolated 
pixel X (step 20). 

[0147] Although description was made of the image interpolating method using a case where there are two sets of 
5 opposed pixels, the number of sets of opposed pixels may be two or more. 

[0148] In the image interpolating device configured as shown in Fig. 7 or 8, when image interpolation is performed 
using the second image interpolating method, the correlation value operating unit 2 may be caused to perform the 
processing at the steps 11 to 16 shown in Fig. 10. 

[0149] Description is now made of the operation of the correlation value operating unit 2 in a case where pixel data 
io x on an interpolated pixel X shown in Fig. 15 is found. Further, description is made of a case where the number of sets 
of diagonally opposed pixels is six. 

[0150] The correlation value operating unit 2 first finds an edge component E on the basis of the following equation 
(44), as described at the step 11 shown in Fig. 10: 
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E = -d05 + d1 5 + d25 - d35 (44) 



[0151] An edge component E1 whose effect of a noise component has been reduced is then found on the basis of 
the edge component E, as described at the steps 12 to 14 shown in Fig. 10. That is, the edge component E1 after the 
20 correction is corrected on the basis of the following equations (45): 

E1 = 0 (-Q ^ E ^ Q) 

25 E1 = E (E > Q or E < -Q) (45) 

[01 52] A range S where the pixel data x on the interpolated pixel X is settable is then found, as described at the step 
15 shown in Fig. 10, by the edge component E1 thus found. 

[0153] Candidates for the pixel data on the interpolated pixel X are then found in the same method as that described 
30 at the step 1 6 shown in Fig. 1 0. In this example, the number of sets of opposed pixels between which the interpolated 
pixel X is sandwiched diagonally is six. 

[0154] On the basis of the following equations (46) to (51) respectively expressing a correlation value L1 between 
pixel data on opposed pixels D1 2 and D28 and the pixel data on the interpolated pixel X, a correlation value L2 between 
pixel data on opposed pixels D1 3 and D27 and the pixel data on the interpolated pixel X, a correlation value L3 between 

35 pixel data on opposed pixels D1 4 and D26 and the pixel data on the interpolated pixel X, a correlation value R1 between 
pixel data on opposed pixels D1 8 and D26 and the pixel data on the interpolated pixel X, a correlation value R2 between 
pixel data on opposed pixels D17 and D23 and the pixel data on the interpolated pixel X, and a correlation value R3 
between pixel data on opposed pixels D1 6 and D24 and the pixel data on the interpolated pixel, the respective minimums 
L1 min to L3 min and R1 mjn to R3 mjn of the correlation values L1 to L3 and R1 to R3 and pixel data x1 1 to x3l and x1 r to 

40 x3r in a case where the minimums are respectively given are found: 

L1 = Id12-xl + Id28-xl + p1 x Hla - p2 x Via (46) 



L2 = ld13-xl + Id27-xl + p1 X HIb - p2 X VIb (47) 



L3 = Id14-xl + Id26-xl + p1 X HIc - p2 x Vic (48) 



R1 = Id18-xl + Id22-xl + p1 x Hra - p2 x Vra (49) 



R2 = Id17-xl + Id23-xl + p1 x Hrb - p2 x Vrb (50) 



R3 = Id16-xl + Id24-xl + pi x Hrc - p2 x Vrc (51) 



18 



EP1 173 017 A1 

[01 55] Hla to HIc, Hra to Hrc, Via to Vic, and Vra to Vrc in the foregoing equations (46) to (51 ) are expressed by the 
following equations (52) to (63); 

Hla=MAX(Hla1,Hla2) (52) 

Hlb= MAX(Hlb1, HIb2) (53) 

Hlc= MAX(Hlc1, Hlc2) (54) 

Hra = MAX(Hra1 , Hra2) (55) 

Hrb = MAX(Hrb1 , Hrb2) (56) 

Hrc = MAX(Hrc1 , Hrc2) (57) 

Vla= MIN(Vla1, Vla2) (58) 

Vlb=MIN(Vlb1, Vlb2) (59) 

Vlc= MIN(Vlc1, Vlc2) (60) 

Vra= MIN(Vra1, Vra2> (61) 

Vrb = MIN(Vrb1, Vrb2) (62) 

Vrc=MIN(Vrc1, Vrc2) (63) 

[0156] Furthermore, Hla1 to Hid , Hla2 to Hlc2, Hra1 to Hrc1 , Hra2 to Hrc2, Vla1 to Vlc1 , Vla2 to Vlc2, Vra1 to Vrc2, 
and Vra2 to Vrc2 in the foregoing equations (52) to (63) are expressed by the following equations (64) to (87): 

Hla1 =ld11-d12l + ld12-d13l (64> 

Hlb1 = Id12-d13l + Id13-d14l (65) 

Hid = Id13-d14l + Id14-d15l (66) 

Hla2 = Id27-d28l + Id28-d29l (67) 

Hlb2 = Id26-d27l + Id27-d28l (68) 



19 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



EP1 173 017 A1 

Hlc2 = Id25-d26l + Id26-d27l (69) 

Hra1 = Id17-d18l + Id18-d19l (70) 

Hrb1 = Id16-d17l + Id17-d18l (71) 

Hrd = Id15-d16l + Jd16-d17l (72) 

Hra2 = Id21 -d22l + Id22-d23! (73) 

Hrb2 = Id22-d23l + Id23-d24l (74) 

Hrc2 = Id23-d24l + Id24-d25l (75) 

Vla1 = Id02-d12l + Id12-d22l ) (76) 

Vlb1 = Id03-d1 31 + Id1 3-d23l (77) 

Vlc1 = Id04-d14l + Id1 4-d24l (78) 

Vla2 = Id1 8-d28l + Id28-d38l (79) 

Vlb2 = ld17-d27l + ld27-d37l (80) 

Vlc2 = Id16-d26l + Id26-d36l (81) 

Vra1 = Id08-d1 81 + Id1 8-d28l (82) 

Vrb1 = Id07<d17l + Id17-d27l (83) 

Vrc1 = Id06-d1 61 + Id1 6-d26l (84) 

Vra2 = Id12-d22l + Id22-d32l (85) 

Vrb2 = Id1 3-d23l + Id23-d33l (86) 

Vrc2 = Id14-d24l + Id24-d34l (87) 
[01 57] When the minimum correlation values L1 min to L3 mln and R1 min to R3 min and the pixel data x1 1 to x3l and x1 r 
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to x3r in a case where the minimums are respectively given are thus found in the correlation value operating unit 2, 
the minimum correlation values L1 min to L3 min and R1 min to R3 min are fed to the minimum extracting unit 3, and the 
pixel data x1 1 to x3l and x1 r to x3r are fed to the pixel data selecting unit 4. 

[0158] A method of determining the settable range S at the step 15 shown in Fig. 10 differs from the method of 
5 determining the settable range S at the step 2 shown in Fig. 2. The advantage of the method of determining the settable 
range S at the step 15 shown in Fig. 10 will be described using Fig. 16. 

[0159] In Fig. 1 6, a black circle, a white circle, a hatched circle respectively indicate an original pixel represented by 
black data, an original pixel represented by white data, and a gray original pixel. X denotes an interpolated pixel. In 
the description of Fig. 16, the white data shall be "1", the black data shall be "0", and the gray data shall be "0.5" in 
10 order to simplify description. 

[01 60] As shown in Fig. 1 6, there is a case where there are two black lines in a white background, and their boundary 
is gray. In such a case, it is preferable that pixel data on a pixel X to be interpolated between gray pixels in the boundary 
is the black data "0". 

[0161] Description is made of a case where the pixel data on the interpolated pixel X is found by the first image 
15 interpolating method. In this case, an edge component E (= -d04 + d14 + d24 - d34) is -1 + 0.5 + 0.5 -1 = -1 , and a 
range S where the pixel data x on the interpolated pixel X is settable is 0.5. Consequently, the pixel data x on the 
interpolated pixel X is 0.5, and is not black data. 

[01 62] Description is made of a case where the pixel data on the interpolated pixel X is found, as in the second image 
interpolating method. Also in this case, an edge component E (= -d04 + d14 + d24 - d34) is - 1 + 0.5 + 0.5 - 1 = -1 . 
20 Further, E1 =-1. 

[0163] Since E1 < 0, the range S where the pixel data x on the interpolated pixel X is settable is d min x a + dc x 
(1-a) + E1 xy^s^ d max xa + dcx (1-a). For convenience of illustration, when a = 1 andy= 0.5, the settable range 
S is d min + E1 x 0.5 ^ S ^ d max . That is, 0.5 - 0.5 ^ S ^ 0.5, i.e., 0 ^ S ^ 0.5. 

[0164] For convenience of illustration, when the minimum of the correlation values corresponding to opposed pixels 
25 D13 and D25 is found within the settable range S, considering p in the equations (46) to (51) for finding the correlation 
values to be zero, 11-0.51 + 11-0.51 = 1 , and the pixel data x in a case where the minimum correlation value is given is 
0.5. Further, the minimum of the correlation values correspending to opposed pixels D15 and D23 is I0-0! + I0-OI = 0, 
and the pixel data x in a case where the minimum correlation value is given is zero. Consequently, the pixel data x on 
the interpolated pixel X is zero. 
30 [0165] A correlation value calculating equation used at the step 16 shown in Fig. 10 and the correlation value cal- 
culating equation used at the step 3 shown in Fig. 2 differ from each other. The advantage of the correlation value 
calculating equation used at the step 16 shown in Fig. 16 will be described using Fig. 17. 

[0166] in Fig. 17, a black circle and a white circle respectively indicate an original pixel represented by black data 
and an original pixel represented by white data. X denotes an interpolated pixel. In the description of Fig. 1 7, the white 

35 data shall be "1 ", the black data shall be "0", and gray data shall be "0.5" in order to simplify the description. 

[01 67] As shown in Fig. 1 7, in a case where there is a black line in a white background, when the pixel X is interpolated 
between an original pixel D14 and an original pixel D24, pixel data on the interpolated pixel X is made larger than the 
pixel data on the interpolated pixel between an original pixel D13 and an original pixel D23, so that the thickness of 
the line is changed in the first image interpolating method. 

40 [0168] In such a case, when the correlation value is found in consideration with the connection with pixels in the 
vicinity of the opposed pixels as in the second image interpolating method, the pixel data on the interpolated pixel X 
between the original pixel D14 and the original pixel D24 can be made equal to the pixel data on the interpolated pixel 
between the original pixel D13 and the original pixel D23. 

45 [3] Description of Third Image Interpolating Method 

[0169] Description is now made of a third image interpolating method. 

[0170] Fig. 18 illustrates the relationship between original pixels and a pixel to be interpolated. 
[0171] In the third image interpolating method, a pixel is interpolated at a central position among four original pixels 
50 D12, D13, D22, and D23, as shown in Fig. 18. 

[0172] Description is now made of a method of finding pixel data on an interpolated pixel X arranged at the central 
position among the four original pixels D12, D13, D22, and D23. 

[0173] Pixel data on original pixels D01 to D04, D11 to D14, D21 to D24, and D31 to D34 and the pixel data on the 
interpolated pixel X are respectively denoted by d01 to d04, d11 to d14, d21 to d24, and d31 to d34 and x. 
55 [0174] Fig. 19 shows the procedure for image interpolation processing by the third image interpolating method. 

[01 75] First, two types of edge components EL and ER are calculated in order to judge whether or not the interpolated 
pixel X exists in the vicinity of an edge of an original image (step 31). That is, the edge component EL is calculated on 
the basis of the following equation (88) using the pixel data on the original pixels D01, D12, D23, and D34, and the 
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edge component ER is calculated on the basis of the following equation (89) using the pixel data on the original pixels 
D04, D13, D22,and D31: 

5 EL = -d01 + d1 2 + d23 - d34 (88) 

ER = -d04 + d13 + d22-d31 (89) 

10 [0176] Ranges SL and SR where the pixel data x on the interpolated pixel X is settable are then determined for the 
edge components EL and ER (step 32). 

[0177] That is, the range SL where the pixel data x on the interpolated pixel X is settable is found on the basis of the 
edge component EL, and the range SR where the pixel data x on the interpolated pixel X is settable is found on the 
basis of the edge component ER, as at the step 2 shown in Fig. 2. 
is [0178] Specifically, letting Th be a predetermined threshold, dL max be the larger one of the pixel data d12 on the 
original pixel D12 and the pixel data d23 on the original pixel D23, dL min be the smaller one of the pixel data d12 and 
d23, and dL be dL max -dL min , the settable range SL is found on the basis of the following expression (90).: 
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if EL > Th, then dL m|n + dL/2 ^ SL ^ dL max , 
if - Th £ EL ^ Th, then dL mln + dU4 ^ SL ^ dL max - dLV4, and 

if E < -Th, then dL mjn ^ SL ^ dL mjn + 6U2 (90) 

[0179] Letting dR max be the larger one of the pixel data d13 on the original pixel D13 and the pixel data d22 on the 
original pixel D22, dR m[n be the smaller one of the pixel data d1 3 and d22, and dR be dR max - dR min , the settable range 
SR is found on the basis of the following expression (91): 



if ER > Th, then dR mjn + dR/2 ^ SR ^ dR max , 
if -Th ^ ER ^ Th, then dR min + dR/4 ^ SR ^ dR max - dR/4, and 
35 if ER < -Th, then dR mln ^ SR ^ dR min + dR/2 (91) 

[0180] It is then judged whether or not there exist portions which are overlapped with each other in both the settable 
ranges SL and SR (step 33). 

[0181] When there are portions which are overlapped with each other in both the settable ranges SL and SR, as 
shown in Fig. 20 (a), the overlapped portions are taken as a range S where the pixel data x on the interpolated pixel 
X is settable (step 34). 

[0182] Candidates for the pixel data on the interpolated pixel X are found from the range where the pixel data x on 
the interpolated pixel X is settable on the basis of pixel data on opposed pixels between which the interpolated pixel 
X is sandwiched diagonally (step 35). 

[0183] On the basis of the following equations (92) to (97) respectively expressing a correlation value L1 between 
the pixel data on the original pixels D11 and D24 and the pixel data on the interpolated pixel X, a correlation value L2 
between the pixel data on the original pixels D12 and D23 and the pixel data on the interpolated pixel X, a correlation 
value L3 between the pixel data on the original pixels D02 and D33 and the pixel data on the interpolated pixel X, a 
correlation value R1 between the pixel data on the original pixels D14 and D21 and the pixel data on the interpolated 
pixel X, a correlation value R2 between the pixel data on the original pixels D13 and D22 and the pixel data on the 
interpolated pixel X, and a correlation value R3 between the pixel data on the original pixels D03 and D32 and the pixel 
data on the interpolated pixel X, the respective minimums L1 mjn to L3 min and R1 mjn to R3 mjn of the correlation values 
L1 to L3 and R1 to R3 and pixel data x1 1 to x3l and x1r to x3r in a case where the minimums are respectively given 
are found in the same method as the second method at the step 3 shown in Fig. 2: 



L1 =ld11-xl + ld24-xl (92) 
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L2 = ld12-xl + ld23-xl 



(93) 



5 



L3 = Id02-xl + Id33-xl 



(94) 



R1 = ld14-xl + ld21-xl 



(95) 



10 



R2= Id13-xl + ld22-xl 



(96) 



R3 = Id03-xl + Id32-xl 



(97) 



15 



[0184] The minimum correlation value which is the minimum of the minimum correlation values L1 min to L3 min and 
R1 m[n to R3 mjn thus found is selected, and the pixel data corresponding to the selected minimum correlation value is 
extracted from the pixel data x1 1 to x3l and x1 r to x3r (step 36). 

[0185] The pixel data x on the interpolated pixel X is found on the basis of the pixel data extracted at the step 36 
20 (step 37). 

[0186] That is, the pixel data and the pixel data which are respectively the maximum and the minimum are extracted 
from the pixel data extracted at the step 36, and the average of the two pixel data is then calculated. The result of the 
calculation is taken as the pixel data x on the interpolated pixel X. When the number of the pixel data selected at the 
step 36 is one, the pixel data is determined as the pixel data x on the interpolated pixel X. 
25 [0187] The average of the pixel data extracted at the step 36 may be calculated, to determine the result of the 
calculation as the pixel data x on the interpolated pixel X. 

[01 88] Pixel data obtained from opposed pixels in closest proximity to the interpolated pixel X may be extracted from 
the pixel data selected at the step 36, to take the extracted pixel data as the pixel data x on the interpolated pixel X. 
In this case, when there are two pixel data obtained from the set of opposed pixels in closest proximity to the interpolated 

30 pixel X, the average of the pixel data is taken as the pixel data x on the interpolated pixel X. 

[0189] When it is judged at the foregoing step 33 that the settable ranges SL and SR respectively found by the edge 
components EL and the ER are not overlapped with each other, as shown in Fig. 20 (b), the average 
(d12+d13+d22+d23)/4 of the pixel data d12, d13, d22, and d23 on the four original pixels D12, D13, D22, and D23 is 
determined as the pixel data x on the interpolated pixel X (step 38). 

35 [0190] When image interpolation is performed using the third image interpolating method in the image interpolating 
device configured as shown in Figs. 7 and 8, the correlation value operating unit 2 may be caused to perform the 
processing at the steps 31 to 35 and the step 38 shown in Fig. 19. 

[01 91 ] That is, the correlation value operating unit 2 first finds the edge components EL and E R, and finds the settable 
ranges SL and SR for the found edge components EL and ER. When there are portions which are overlapped with 
40 each other in the settable ranges SL and SR, the minimum correlation values L1 mjn to L3 min and R1 min to R3 min and 
the pixel data x1 1 to x3l and x1 r to x3r in a case where the minimum correlation values are respectively given are thus 
found. The found minimum correlation values L1 mjn to L3 mjn and R1 min to R3 mjn are fed to the minimum extracting unit 
3, and the pixel data x1 1 to x3l and x1 r to x3r are fed to the pixel data selecting unit 4. 

[0192] On the other hand, when the settable ranges SL and SR found by the edge components El and ER are not 
45 overlapped with each other, the average of the pixel data on the four pixels D12, D13, D22, and D23 is outputted to 
the output terminal OUT as the pixel data x on the interpolated pixel X. 

[0193] Although in the above-mentioned example, the pixel data on the interpolated pixel is found using six sets of 
opposed pixels, the number of sets of opposed pixels is not limited to six. The pixel data on the interpolated pixel may 
be found using more sets of opposed pixels. 



[4] Description of Fourth Image Interpolating Method 

[0194] Description is now made of a fourth image interpolating method. 

[01 95] In the fourth image interpolating method, a pixel is interpolated at a central position among four original pixels 
55 D12, D13, D22, and D23, as shown in Fig. 18, as in the third image interpolating method. However, the fourth image 
interpolating method slightly differs from the third image interpolating method. 

[0196] Description is now made of a method of finding pixel data on an interpolated pixel arranged at the central 
position among the fourth original pixels D12, D13, and D22, and D23. 
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[0197] Pixel data on original pixels D01 to D04, D11 to D14, D21 to D24, and D31 to D34 and the pixel data on the 
interpolated pixel X are respectively denoted by d01 to d04, d11 to d14, d21 to d24, and d31 to d34 and x. 
[0198] Fig. 21 shows the procedure for image interpolation processing by the fourth image interpolating method. 
[01 99] First, two types of edge components EL and ER are calculated in order to judge whether or not the interpolated 
pixel X exists in the vicinity of an edge of an original image (step 41). That is, the edge component EL is calculated on 
the basis of the following equation (98) using the pixel data on the original pixels D01, D12, D23, and D34, and the 
edge component ER is calculated on the basis of the following equation (99) using the pixel data on the original pixels 
D04, D13, D22, and D31: 

EL = -d01 + d1 2 + d23 - d34 (98) 



ER = -d04 + d13 + d22-d31 (99) 

[0200] Correction processing is then performed with respect to the edge component EL. That is, it is judged whether 
or not the edge component EL is within a range of -Q ^ EL ^ Q, letting N be a pseudo noise component previously 
set (step 42). 

[0201] The edge component EL is corrected on the basis of the result of the judgment. That is, letting EL1 be an 
edge component after the correction, the edge component EL1 after the correction is set to zero when the edge com- 
ponent EL is within the range of -Q ^ EL ^ Q (step 43). 

[0202] When the edge component ER is outside the range of -Q ^ EL ^ Q, that is, EL < -Q or EL > Q, the edge 
component E1 after the correction is taken as EL (step 44). 

[0203] Similar correction processing is then also performed with respect to the edge component ER. That is, it is 
judged whether or not the edge component ER is within the range of -Q ^ ER ^ Q, letting N be a pseudo noise 
component previously set (step 45). 

[0204] The edge component ER is corrected on the basis of the result of the judgment. That is, letting ER1 be an 
edge component after the correction, the edge component ER1 after the correction is set to zero when the edge com- 
ponent EL is within the range of - Q ^ ER ^ Q (step 46). 

[0205] When the edge component ER is outside the range of -Q ^ ER ^ Q, that is, ER < -Q or ER > Q, the edge 
component ER1 after the correction is taken as ER (step 47). 

[0206] A range SL where the pixel data x on the interpolated pixel X is settable is then determined on the basis of 
EL1 after the correction, and a range SR where the pixel data x on the interpolated pixel X is settable is then determined 
on the basis of ER1 after the correction (step 48). A method of finding the settable ranges SL and SR is the same as 
that at the step 15 shown in Fig. 10. 

[0207] Specifically, letting dL max be the larger one of the pixel data d12 on the original pixel D12 and the pixel data 
d23 on the original pixel D23, dL mln be the smaller one of them, dLc be the average of dL max and dL m j n , and a and y 
be previously set factors, the settable range SL is found on the basis of the following expression (1 00): 

if EL1 ^ 0, then dL mjn . a + dLc(1-a) ^ SL ^ dL max . a + dLc(1-a) + EL1 -y, and 
if EL1 < 0, then dL mjn • a + dLc(1-a) + EL1 • y = SL ^ dL max ■ a + dLc(1-a) (100) 

[0208] Letting dR max be the larger one of the pixel data d13 on the original pixel D13 and the pixel data d22 on the 
original pixel D22, dR mjn be the smaller one of them, dRc be the average of dR max and dR mjni and a and y be previously 
set factors, the settable range SR is found on the basis of the following expressions (101): 

if ER1 ^ 0, then dR mjn . a + dRc(1-a) ^ SR ^ dR max • a + dRc(1-a) + ER1 . y, and 

if ER1 < 0, then dR mln • a + dRc(1-a) + ER1 - ygSRg dR max - a + dRc(1-a) (101) 

[0209] It is then judged whether or not there are portions which are overlapped with each other in both the settable 
ranges SL and SR (step 49). 

[0210] When there are portions which are overlapped with each other in both the settable ranges SL and SR, the 
overlapped portions are taken as a range S where the pixel data x on the interpolated pixel X is settable (step 50). 
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[0211] Candidates for the pixel data on the interpolated pixel X are found from the range where the pixel data x on 
the interpolated pixel X is settable on the basis of pixel data on opposed pixels between which the interpolated pixel 
X is sandwiched diagonally (step 51). 

[021 2] On the basis of the following equations (1 02) to (1 07) respectively expressing a correlation value L1 between 
the pixel data on the original pixels D11 and D24 and the pixel data on the interpolated pixel X, a correlation value L2 
between the pixel data on the original pixels D12 and D23 and the pixel data on the interpolated pixel X, a correlation 
value L3 between the pixel data on the original pixels D02 and D33 and the pixel data on the interpolated pixel X, a 
correlation value R1 between the pixel data on the original pixels D14 and D21 and the pixel data on the interpolated 
pixel X, a correlation value R2 between the pixel data on the original pixels D13 and D22 and the pixel data on the 
interpolated pixel X, and a correlation value R3 between the pixel data on the original pixels D03 and D32 and the pixel 
data on the interpolated pixel X, the respective minimums L1 min to L3 min and R1 min to R3 min of the correlation values 
L1 to L3 and R1 to R3 and pixel data x1 1 to x3l and x1 r to x3r in a case where the minimums are respectively given 
are found in the same method as the second method at the step 3 shown in Fig. 2: 



L1 = ld11-xl + ld24-xl (102) 

L2 = Id12-xl + ld23-xl (103) 

L3 = Id02-xl + Id33-xl (104) 

R1 = Id14-xl + Id21-xl (105) 

R2 = ld13-xl + ld22-xl (106) 

R3 = Id03-xl + Id32-xl (107) 



[0213] The minimum correlation value which is the minimum of the minimum correlation values L1 min to L3 min and 
R1 min to R3 mjn thus found is selected, and the pixel data corresponding to the selected minimum correlation value is 
extracted from the pixel data x1 1 to x3l and x1 r to x3r (step 52). 

[0214] The pixel data x on the interpolated pixel X is found on the basis of the pixel data extracted at the step 52 
(step 53). 

[0215] That is, the pixel data and the pixel data which are respectively the maximum and the minimum are extracted 
from the pixel data extracted at the step 52, and the average of the two pixel data is then calculated. The result of the 
calculation is taken as the pixel data x on the interpolated pixel X. When the number of pixel data extracted at the step 
52 is one, the pixel data is determined as the pixel data x on the interpolated pixel X. 

[0216] The average of the pixel data extracted at the step 52 may be calculated, to determine the result of the 
calculation as the pixel data x on the interpolated pixel X. 

[0217] Pixel data obtained from opposed pixels in closest proximity to the interpolated pixel X may be extracted from 
the pixel data selected at the step 52, to take the extracted pixel data as the pixel data x on the interpolated pixel X. 
In this case, when there are two pixel data obtained from the set of opposed pixels in closest proximity to the interpolated 
pixel X, the average of the pixel data is taken as the pixel data x on the interpolated pixel X. 

[0218] When it is judged at the foregoing step 49 that the settable ranges SL and SR respectively found by the edge 
components EL1 and ER1 are not overlapped with each other, the average (d12+d13+d22+d23)/4 of the pixel data 
d12, d13, d22, and d23 on the four original pixels D12, D13, D22, and D23 is determined as the pixel data x on the 
interpolated pixel X (step 54). 

[0219] When image interpolation is performed using the fourth image interpolating method in the image interpolating 
device configured as shown in Fig . 7 or 8, the correlation value operating unit 2 may be caused to perform the processing 
at the steps 41 to 51 and the step 54 shown in Fig. 21 . 
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Claims 

1. In an image interpolating method for interpolating a pixel at an intermediate position between a first original pixel 
and a second original pixel adjacent to the first original pixel, an image interpolating method is characterized by 
5 comprising: 

a first step of calculating an edge component for judging whether or not an interpolated pixel exists in the 
vicinity of an edge position of original image data; 

a second step of finding a range where pixel data on the interpolated pixel is settable on the basis of the 
10 calculated edge component and pixel data on the first and second original pixels; 

a third step of selecting a plurality of sets of opposed pixels between which the interpolated pixel is sandwiched 
diagonally, and finding, for each of the sets, the pixel data on the interpolated pixel in a case where a correlation 
value represented by the sum of the absolute values of the differences between the pixel data on the interpo- 
lated pixel and pixel data on the opposed pixels is the minimum in the range where the pixel data on the 
15 interpolated pixel is settable and the minimum correlation value; and 

a fourth step of finding the pixel data on the interpolated pixel on the basis of the pixel data on the interpolated 
pixel in the case where the correlation value is the minimum and the minimum correlation value which are 
found for each of the sets. 

20 2. The image interpolating method according to claim 1 , characterized in that when an original pixel adjacent to the 
first original pixel and opposite to the second original pixel is taken as a third original pixel, and an original pixel 
adjacent to the second original pixel and opposite to the first original pixel is taken as a fourth original pixel, the 
edge component is calculated on the basis of pixel data on the first to fourth original pixels at the first step. 

25 3. The image interpolating method according to claim 2, characterized in that letting d1 be the pixel data on the first 
original pixel, 62 be the pixel data on the second original pixel, d3 be the pixel data on the third original pixel, and 
d4 be the pixel data on the fourth original pixel, an edge component E is calculated on the basis of an equation 
for operation E = -d3 + d1 + 62 - d4. 

30 4. The image interpolating method according to claim 3, characterized in that letting E be the edge component 
found at the first step, Th be a predetermined threshold, d max be the larger one of the pixel data on the first original 
pixel and the pixel data on the second original pixel, d mln be the smaller one of them, and d be d max -d mjn , a range 
S where the pixel data on the interpolated pixel is settable is found on the basis of the following expression at the 
second step: 
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if E > Th, then d min + d/2 ^ S ^ d 



max* 



4Q if -Th ^ E ^ Th, then d mln + d/4 ^ S =i d max -d/4, and 

if E < -Th, then d min =i S ^ d mjn + d/2. 

45 5. The image interpolating method according to claim 1 , characterized in that letting x be the pixel data in the settable 
range S found at the second step , and da and db be respectively the pixel data on the two original pixels composing 
one set of opposed pixels, a correlation value L corresponding to the set is calculated by L = Ida-xl + Idb-xl. 



6. The image interpolating method according to claim 1 , characterized in that the fourth step comprises the steps of 



selecting the minimum of the minimum correlation values found for the sets at the third step, 

extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
55 interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 

on the interpolated pixel, and 

determining, when there are a plurality of minimums of the minimum correlation values, the average of the 
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pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 
respectively given as the pixel data on the interpolated pixel. 

The image interpolating method according to claim 1 , characterized In that the fourth step comprises the steps of 

selecting the minimum of the minimum correlation values found for the sets at the third step, 

extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

extracting, when there are a plurality of minimums of the minimum correlation values, the maximum and the 
minimum of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation 
values are respectively given, and determining the average of the extracted maximum and minimum as the 
pixel data on the interpolated pixel. 

The image interpolating method according to claim 1 , characterized in that the fourth step comprises the steps of 

selecting the minimum of the minimum correlation values found for the sets at the third step, 

extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

selecting, when there are a plurality of minimums of the minimum correlation values, the pixel data obtained 
from opposed pixels in closest proximity to the interpolated pixel out of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum correlation values are respectively given, and determining, 
when the number of the selected pixel data is one, the pixel data as the pixel data on the interpolated pixel, 
while determining, when the number of the selected pixel data is two, the average of the pixel data as the pixel 
data on the interpolated pixel. 

In an image interpolating method for interpolating a pixel at an intermediate position between a first original pixel 
and a second original pixel adjacent to the first original pixel, an image interpolating method is characterized by 

comprising: 

a first step of calculating an edge component for judging whether or not an interpolated pixel exists in the 
vicinity of an edge position of original image data; 

a second step of correcting the calculated edge component on the basis of a predetermined pseudo noise 
component; 

a third step of finding a range where pixel data on the interpolated pixel is settable on the basis of an edge 
component after the correction and pixel data on the first and second original pixels; 

a fourth step of selecting a plurality of sets of opposed pixels between which the interpolated pixel is sand- 
wiched diagonally, and finding, for each of the sets, the pixel data on the interpolated pixel in a case where a 
correlation value represented by the sum of the absolute values of the differences between the pixel data on 
the interpolated pixel and pixel data on original pixels in the vicinity of the opposed pixels is the minimum in 
the range where the pixel data on the interpolated pixel is settable and the minimum correlation value; and 
a fifth step of finding the pixel data on the interpolated pixel on the basis of the pixel data on the interpolated 
pixel in the case where the correlation value is the minimum and the minimum correlation value which are 
found for each of the sets. 

The image interpolating method according to claim 9, characterized in that when an original pixel adjacent to the 
first original pixel and opposite to the second original pixel is taken as a third original pixel, and an original pixel 
adjacent to the second original pixel and opposite to the first original pixel is taken as a fourth original pixel, the 
edge component is calculated on the basis of pixel data on the first to fourth original pixels at the first step. 

The image interpolating method according to claim 9, characterized in that letting d1 be the pixel data on the first 
original pixel, d2 be the pixel data on the second original pixel, d3 be the pixel data on the third original pixel, and 
d4 be the pixel data on the fourth original pixel, an edge component E is calculated on the basis of an equation 
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for operation E = - d3 + d1 + d2 - d4. 



EP 1 173 017 A1 



12. The image interpolating method according to claim 11 , characterized in that letting Q be a pseudo noise compo- 
nent, and E be the edge component calculated at the first step, an edge component E1 after the correction found 
5 at the second step is given by the following expression: 

if -Q ^ E ^ Q, then E1 = 0, and 



if E > Q or E < -Q, then E1 = E. 



13. The image interpolating method according to claim 12, characterized in that letting E1 be the edge component 
after the correction found at the second step, d max be the larger one of the pixel data on the first original pixel and 
15 the pixel data on the second original pixel, d m[n be the smaller one of them, dc be the average of d max and d mjn , 

and a(O^a^l) and y be previously set factors, a range S where the pixel data on the interpolated pixel is 
settable is found on the basis of the following expression at the third step: 

20 if E1 ^ 0, then d mjn • a + dc (1-a) ^ S ^ d max • a + dc(1-a) + E1 • y, and 

if E1 < 0, then d min - a + dc (1 -a) + E1 • y ^ S ^ d max • a + dc (1 -a). 

25 14. The image interpolating method according to claim 9, characterized in that 

when a direction connecting the first original pixel and the second original pixel is defined as a vertical di- 
rection, a direction perpendicular to the vertical direction is defined as a right-and-left direction, a set of opposed 
pixels is taken as D12 and D24, two original pixels adjacent to the one opposed pixel D12 on the right and left 
sides are taken as D11 and D13, two original pixels adjacent to the opposed pixel D12 on the upper and lower 

30 sides are taken as D02 and D22, two original pixels adjacent to the other opposed pixel D24 on the right and left 

sides are taken as D23 and D25, two original pixels adjacent to the opposed pixel D24 on the upper and lower 
sides are taken as D14 and D34, pixel data on the original pixels D02, D11 , D12, D13, D14, D22, D23, D24, D25, 
and D34 are respectively taken as d02, d11 , d12, d13, d14, d22, d23, d24, d25, and d34, p1 and P2 are taken as 
predetermined factors, and the pixel data in the settable range S found at the third step is taken as x, an equation 

35 for calculating the correlation value L corresponding to the set is expressed by the following equations: 

L = Id12-xl + Id24-xl 4- p1 -HI - p2V1 



H1 = MAX{(ld11-d12l + Id12-d13l), (Id23-d24l + Id24-d25l)} 



V1 = MIN{(ld02-d12l + Id12-d22l), (Id14-d24l + Id24-d34l)} 



15. The image interpolating method according to claim 9, characterized in that the fifth step comprises the steps of 



selecting the minimum of the minimum correlation values found for the sets at the fourth step, 
extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 
50 correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

determining, when there are a plurality of minimums of the minimum correlation values, the average of the 
55 pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 

respectively given as the pixel data on the interpolated pixel. 



28 



EP1 173 017 A1 



16. The image interpolating method according to claim 9, characterized in that the fifth step comprises the steps of 

selecting the minimum of the minimum correlation values found for the sets at the fourth step, 
extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 
5 correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

extracting, when there are a plurality of minimums of the minimum correlation values, the maximum and the 
io minimum of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation 

values are respectively given, and determining the average of the extracted maximum and minimum as the 
pixel data on the interpolated pixel. 

17. The image interpolating method according to claim 9, characterized in that the fifth step comprises the steps of 

selecting the minimum of the minimum correlation values found for the sets at the fourth step, 
extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 
correlation values is given; 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

selecting, when there are a plurality of minimums of the minimum correlation values, the pixel data obtained 
from opposed pixels in closest proximity to the interpolated pixel out of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum correlation values are respectively given, and determining, 
when the number of the selected pixel data is one, the pixel data as the pixel data on the interpolated pixel, 
while determining, when the number of the selected pixel data is two, the average of the pixel data as the pixel 
data on the interpolated pixel. 

18. In an image interpolating method for interpolating a pixel at a central position among four original pixels comprising 
30 a first original pixel and a second original pixel which are adjacent to each other on the right and left sides, a third 

pixel adjacent to the first original pixel on the lower side, and a fourth pixel adjacent to the second original pixel 
on the lower side, an image interpolating method is characterized by comprising: 

a first step of calculating a first edge component forjudging whether or not an interpolated pixel exists in the 

35 vicinity of an edge position of original image data on the basis of pixel data on the first original pixel, the fourth 

original pixel, a fifth original pixel on an extension of a line connecting the first original pixel and the fourth 
original pixel and adjacent to the first original pixel diagonally to the upper left, and a sixth original pixel on the 
extension of the line connecting the first original pixel and the fourth original pixel and adjacent to the fourth 
original pixel diagonally to the lower right; 

40 a second step of calculating a second edge component forjudging whether or not the interpolated pixel exists 

in the vicinity of the edge position of the original image data on the basis of pixel data on the second original 
pixel, the third original pixel, a seventh original pixel on an extension of a line connecting the second original 
pixel and the third original pixel and adjacent to the second original pixel diagonally to the upper right, and an 
eighth original pixel on the extension of the line connecting the second original pixel and the third original pixel 

45 and adjacent to the third original pixel diagonally to the lower left; 

a third step of finding a first range where pixel data on the interpolated pixel is settable on the basis of the first 
edge component and the pixel data on the first and fourth original pixels and a second range where the pixel 
data on the interpolated pixel is settable on the basis of the second edge component and the pixel data on 
the second and third original pixels; 

50 a fourth step of judging whether or not portions which are overlapped with each other exist in the first settable 

range and the second settable range; 

a fifth step of calculating, when there exist no portions which are overlapped with each other in the first settable 
range and the second settable range, the average of the pixel data on the first to fourth original pixels, and 
determining the result of the calculation as the pixel data on the interpolated pixel; 
55 a sixth step of setting, when there exist portions which are overlapped with each other in the first settable 

range and the second settable range, the overlapped portions as a settable range, then selecting a plurality 
of sets of opposed pixels between which the interpolated pixel is sandwiched diagonally, and finding, for each 
of the sets, the pixel data on the interpolated pixel in a case where a correlation value represented by the sum 
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of the absolute values of the differences between the pixel data on the Interpolated pixel and pixel data on the 
opposed pixels is the minimum in the range where the pixel data on the interpolated pixel is settable and the 
minimum correlation value; and 

a seventh step of finding the pixel data on the interpolated pixel on the basis of the pixel data on the interpolated 
5 pixel in the case where the correlation value is the minimum and the minimum correlation value which are 

found for each of the sets at said sixth step. 

19. The image interpolating method according to claim 18, characterized in that 

* 

10 letting d1 be the pixel data on the first original pixel, d4 be the pixel data on the fourth original pixel, d5 be the 

pixel data on the fifth original pixel, d6 be the pixel data on the sixth original pixel, and EL be a first edge 
component, the first edge component EL is calculated on the basis of an equation for operation EL = -d5 + d1 
+ d4 - d6 at the first step, and 

letting 62 be the pixel data on the second original pixel, d3 be the pixel data on the third original pixel, 67 be 
15 the pixel data on the seventh original pixel, d8 be the pixel data on the eighth original pixel, and ER be a 

second edge component, the second edge component ER is calculated on the basis of an equation for oper- 
ation ER = -67 + 62 + 63-68 at the second step. 

20. The image interpolating method according to claim 1 9, characterized in that letting EL be the first edge compo- 
se nent, ER be the second edge component, Th be a predetermined threshold, dL max be the larger one of the pixel 

data on the first original pixel and the pixel data on the fourth original pixel, dL min be the smaller one of them, dL 
be dL max -dL mjn , dR max be the larger one of the pixel data on the second original pixel and the pixel data on the 
third original pixel, dR mjn be the smaller one of them, and dR be dR max «dR min , a first settable range SL and a 
second settable range SR are found on the basis of the following expressions at the third step: 



25 



35 



40 



45 



50 



55 



if EL > Th, then dL min + 6U2 =i SL =i dL max5 



if -Th ^ EL ^ Th, then dL mjn + 6UA ^ SL ^ dL majf - dL74, and 



30 — mm 1 — wi W1 -max 



if EL < -Th, then dL mjn ^ SL ^ dL min + 6U2. 



if ER > Th, then dR min + dR/2 ^ SR ^ dR max , 



if -Th ^ ER ^ Th, then dR min + dR/4 ^ SR ^ dR max - dR/4, and 



if ER < -Th, then dR min ^ SR ^ dR mjn + dR/2. 



21. The image interpolating method according to claim 18, characterized in that letting x be the pixel data in the 
settable range S set at the sixth step, and da and db be respectively the pixel data on the two original pixels 
composing one set of opposed pixels, a correlation value L corresponding to the set is calculated by L = Ida-xl + 
Idb-xl. 

22. The image interpolating method according to claim 1 8, characterized in that the seventh step comprises the steps 
of 

selecting the minimum of the minimum correlation values found for the sets at the sixth step, 

extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 
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determining, when there are a plurality of minimums of the minimum correlation values, the average of the 
pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 
respectively given as the 

5 pixel data on the interpolated pixel. 

23. The image interpolating method according to claim 1 8, characterized in that the seventh step comprises the steps 
of 

10 selecting the minimum of the minimum correlation values found for the sets at the sixth step, 

extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 
correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
15 on the interpolated pixel, and 

extracting, when there are a plurality of minimums of the minimum correlation values, the maximum and the 
minimum of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation 
values are respectively given, and determining the average of the extracted maximum and minimum as the 
pixel data on the interpolated pixel. 

20 

24. The image interpolating method according to claim 18, characterized in that the seventh step comprises the steps 
of 

selecting the minimum of the minimum correlation values found for the sets at the sixth step, 
25 extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

30 selecting, when there are a plurality of minimums of the minimum correlation values, the pixel data obtained 

from opposed pixels in closest proximity to the interpolated pixel out of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum correlation values are respectively given, and determining, 
when the number of the selected pixel data is one, the pixel data as the pixel data on the interpolated pixel, 
while determining, when the number of the selected pixel data is two, the average of the pixel data as the pixel 

35 data on the interpolated pixel. 

25. In an image interpolating method for interpolating a pixel at a central position among four original pixels comprising 
a first original pixel and a second original pixel which are adjacent to each other on the right and left sides, a third 
pixel adjacent to the first original pixel on the lower side, and a fourth pixel adjacent to the second original pixel 

40 on the lower side, an image interpolating method is characterized by comprising: 

a first step of calculating a first edge component forjudging whether or not an interpolated pixel exists in the 
vicinity of an edge position of original image data on the basis of pixel data on the first original pixel, the fourth 
original pixel, a fifth original pixel on an extension of a line connecting the first original pixel and the fourth 
45 original pixel and adjacent to the first original pixel diagonally to the upper left, and a sixth original pixel on the 

extension of the line connecting the first original pixel and the fourth original pixel and adjacent to the fourth 
original pixel diagonally to the lower right; 

a second step of calculating a second edge component for judging whether or not the interpolated pixel exists 
in the vicinity of the edge position of the original image data on the basis of pixel data on the second original 
50 pixel, the third original pixel, a seventh original pixel on an extension of a line connecting the second original 

pixel and the third original pixel and adjacent to the second original pixel diagonally to the upper right, and an 
eighth original pixel on the extension of the line connecting the second original pixel and the third original pixel 
and adjacent to the third original pixel diagonally to the lower left; 

a third step of respectively correcting the calculated first and second edge components on the basis of pre- 
55 determined pseudo noise components; 

a fourth step of finding a first range where pixel data on the interpolated pixel is settable on the basis of a first 
edge component after the correction and the pixel data on the first and fourth original pixels and a second 
range where the pixel data on the interpolated pixel is settable on the basis of a second edge component after 
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the correction and the pixel data on the second and third original pixels; 

a fifth step of judging whether or not portions which are overlapped with each other exist in the first settable 
range and the second settable range; 

a sixth step of calculating, when there exist no portions which are overlapped with each other in the first settable 
5 range and the second settable range, the average of the pixel data on the first to fourth original pixels, and 

determining the result of the calculation as the pixel data on the interpolated pixel; 

a seventh step of setting, when there exist portions which are overlapped with each other in the first settable 
range and the second settable range, the overlapped portions as a settable range, then selecting a plurality 
of sets of opposed pixels between which the interpolated pixel is sandwiched diagonally, and finding, for each 

10 of the sets, the pixel data on the interpolated pixel in a case where a correlation value represented by the sum 

of the absolute values of the differences between the pixel data on the interpolated pixel and pixel data on the 
opposed pixels and pixel data on original pixels in the vicinity of the opposed pixels is the minimum in the 
range where the pixel data on the interpolated pixel is settable and the minimum correlation value; and 
an eighth step of finding the pixel data on the interpolated pixel on the basis of the pixel data on the interpolated 

15 pixel in the case where the correlation value is the minimum and the minimum correlation value which are 

found for each of the sets. 

26. The image interpolating method according to claim 25, characterized in that 

20 letting d1 be the pixel data on the first original pixel, d4 be the pixel data on the fourth original pixel, d5 be the 

pixel data on the fifth original pixel, and d6 be the pixel data on the sixth original pixel, and EL be a first edge 
component, the first edge component EL is calculated on the basis of an equation for operation EL = -d5 + d1 
+ d4 - d6 at the first step, and 

letting 62 be the pixel data on the second original pixel, d3 be the pixel data on the third original pixel. 67 be 
25 the pixel data on the seventh original pixel, and d8 be the pixel data on the eighth original pixel, and ER be a 

second edge component, the second edge component ER is calculated on the basis of an equation for oper- 
ation ER = -d7 + 62 + 63 - d8 at the second step. 

27. The image interpolating method according to claim 26, characterized in that letting Q be a pseudo noise com- 
30 ponent, EL be the first edge component, and ER be the second edge component, a first edge component EL1 

after the correction and a second edge component ER1 after the correction which are found at the third step are 
given by the following expressions: 

35 if -Q ^ EL ^ Q, then EL1 = 0, and 

if EL > Q or EL < -Q, then EL1 = EL. 

40 

if -Q ^ ER ^ Q, then ER1 = 0, and 



if ER > Q or ER < -Q, then ER1 = ER. 



45 



28. The image interpolating method according to claim 27, characterized in that letting EL1 be the first edge com- 
ponent after the correction, ER1 be the second edge component after the correction, dL max be the larger one of 
the pixel data on the first original pixel and the pixel data on the fourth original pixel, dL min be the smaller one of 
them, dLc be the average of dL max and dL mjn , dR max be the larger one of the pixel data on the second original 
so pixel and the pixel data on the third original pixel, dR mjn be the smaller one of them, dRc be the average of dR max 

and dR mln , and a and y be previously set factors, a first settable range SL and a second settable range SR are 
found on the basis of the following expressions at the fourth step: 

if EL1 ^ 0, then dL mjn • a + dLc(1-a) ^ SL ^ dL max . a + dLc (1-a) + EL1 . y, and 
if EL1 < 0, then dL mjn - a + dLc(1-a) + EL1 - y ^ SL ^ dL max . a + dLc(1-a). 
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if ER1 ^ 0, then dR mjn • a + dRc(1-a) ^ SR ^ dR max . a + dRc(1 - a ) + ER1 • y, and 

5 if ER1 < 0, then dR mjn • a + dRc(1-a) + ER1 • y ^ SR^ dR max . a + dRc(1 - a) 

29. The image interpolating method according to claim 25, characterized in that letting x be the pixel+ data in the 
settable range S set at the seventh step, and da and db be respectively the pixel data on the two original pixels 
composing one set of opposed pixels, a correlation value L corresponding to the set is calculated by L = Ida-xl + 

™ Idb-xl. 

30. The image interpolating method according to claim 25, characterized in that the eighth step comprises the steps of 

selecting the minimum of the minimum correlation values found for the sets at the seventh step, 
15 extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

20 determining, when there are a plurality of minimums of the minimum correlation values, the average of the 

pixel data on the interpolated pixel in a case where the minimums of the minimum correlation values are 
respectively given as the pixel data on the interpolated pixel. 

31 . The image interpolating method according to claim 25, characterized in that the eighth step comprises the steps of 

25 

selecting the minimum of the minimum correlation values found for the sets at the seventh step, 

extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given, 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
30 interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 

on the interpolated pixel, and 

extracting, when there are a plurality of minimums of the minimum correlation values, the maximum and the 
minimum of the pixel data on the interpolated pixel in a case where the minimums of the minimum correlation 
values are respectively given, and determining the average of the extracted maximum and minimum as the 
35 pixel data on the interpolated pixel. 

32. The image interpolating method according to claim 25, characterized in that the eighth step comprises the steps of 

selecting the minimum of the minimum correlation values found for the sets at the seventh step, 
40 extracting the pixel data on the interpolated pixel in a case where the selected minimum of the minimum 

correlation values is given; 

determining, when the number of minimums of the minimum correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of the minimum correlation values is given as the pixel data 
on the interpolated pixel, and 

45 selecting, when there are a plurality of minimums of the minimum correlation values, the pixel data obtained 

from opposed pixels in closest proximity to the interpolated pixel out of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum correlation values are respectively given, and determining, 
when the number of the selected pixel data is one, the pixel data as the pixel data on the interpolated pixel, 
while determining, when the number of the selected pixel data is two, the average of the pixel data as the pixel 

50 data on the interpolated pixel. 



55 
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